Extract /home/jenkins/oadp-e2e-qe.tar.gz to /alabama/cspi Extract /home/jenkins/oadp-apps-deployer.tar.gz to /alabama/oadpApps Extract /home/jenkins/mtc-python-client.tar.gz to /alabama/pyclient Create and populate /tmp/test-settings... Login as Kubeadmin to the test cluster at https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443... WARNING: Using insecure TLS client config. Setting this option is not supported! Login successful. You have access to 78 projects, the list has been suppressed. You can list all projects with 'oc projects' Using project "default". Create virtual environment and install required packages... Collecting ansible_runner Downloading ansible_runner-2.4.2-py3-none-any.whl.metadata (3.2 kB) Collecting pexpect>=4.5 (from ansible_runner) Downloading pexpect-4.9.0-py2.py3-none-any.whl.metadata (2.5 kB) Collecting packaging (from ansible_runner) Downloading packaging-26.0-py3-none-any.whl.metadata (3.3 kB) Collecting python-daemon (from ansible_runner) Downloading python_daemon-3.1.2-py3-none-any.whl.metadata (4.8 kB) Collecting pyyaml (from ansible_runner) Downloading pyyaml-6.0.3-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (2.4 kB) Collecting ptyprocess>=0.5 (from pexpect>=4.5->ansible_runner) Downloading ptyprocess-0.7.0-py2.py3-none-any.whl.metadata (1.3 kB) Collecting lockfile>=0.10 (from python-daemon->ansible_runner) Downloading lockfile-0.12.2-py2.py3-none-any.whl.metadata (2.4 kB) Downloading ansible_runner-2.4.2-py3-none-any.whl (79 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 79.8/79.8 kB 3.2 MB/s eta 0:00:00 Downloading pexpect-4.9.0-py2.py3-none-any.whl (63 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 63.8/63.8 kB 7.1 MB/s eta 0:00:00 Downloading packaging-26.0-py3-none-any.whl (74 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 74.4/74.4 kB 8.7 MB/s eta 0:00:00 Downloading python_daemon-3.1.2-py3-none-any.whl (30 kB) Downloading pyyaml-6.0.3-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (807 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 807.9/807.9 kB 24.7 MB/s eta 0:00:00 Downloading lockfile-0.12.2-py2.py3-none-any.whl (13 kB) Downloading ptyprocess-0.7.0-py2.py3-none-any.whl (13 kB) Installing collected packages: ptyprocess, lockfile, pyyaml, python-daemon, pexpect, packaging, ansible_runner Successfully installed ansible_runner-2.4.2 lockfile-0.12.2 packaging-26.0 pexpect-4.9.0 ptyprocess-0.7.0 python-daemon-3.1.2 pyyaml-6.0.3 [notice] A new release of pip is available: 23.3.2 -> 26.0.1 [notice] To update, run: pip install --upgrade pip Processing /alabama/oadpApps Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' Preparing metadata (pyproject.toml): started Preparing metadata (pyproject.toml): finished with status 'done' Building wheels for collected packages: ocpdeployer Building wheel for ocpdeployer (pyproject.toml): started Building wheel for ocpdeployer (pyproject.toml): finished with status 'done' Created wheel for ocpdeployer: filename=ocpdeployer-0.0.1-py2.py3-none-any.whl size=241530 sha256=54b1e2d1b2466ca33ada9aff7b587b9af307a7ad705383b9705f8222c762cd45 Stored in directory: /tmp/pip-ephem-wheel-cache-2biysa9g/wheels/55/c3/15/eb89266a7928fafe53678a24892891bbfb18405fbd475eb4c6 Successfully built ocpdeployer Installing collected packages: ocpdeployer Successfully installed ocpdeployer-0.0.1 [notice] A new release of pip is available: 23.3.2 -> 26.0.1 [notice] To update, run: pip install --upgrade pip Processing /alabama/pyclient Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' Preparing metadata (pyproject.toml): started Preparing metadata (pyproject.toml): finished with status 'done' Collecting suds-py3 (from mtc==0.0.1) Downloading suds_py3-1.4.5.0-py3-none-any.whl.metadata (778 bytes) Collecting requests (from mtc==0.0.1) Downloading requests-2.32.5-py3-none-any.whl.metadata (4.9 kB) Collecting jinja2 (from mtc==0.0.1) Downloading jinja2-3.1.6-py3-none-any.whl.metadata (2.9 kB) Collecting kubernetes==11.0.0 (from mtc==0.0.1) Downloading kubernetes-11.0.0-py3-none-any.whl.metadata (1.5 kB) Collecting openshift==0.11.2 (from mtc==0.0.1) Downloading openshift-0.11.2.tar.gz (19 kB) Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' Preparing metadata (pyproject.toml): started Preparing metadata (pyproject.toml): finished with status 'done' Collecting certifi>=14.05.14 (from kubernetes==11.0.0->mtc==0.0.1) Downloading certifi-2026.1.4-py3-none-any.whl.metadata (2.5 kB) Collecting six>=1.9.0 (from kubernetes==11.0.0->mtc==0.0.1) Downloading six-1.17.0-py2.py3-none-any.whl.metadata (1.7 kB) Collecting python-dateutil>=2.5.3 (from kubernetes==11.0.0->mtc==0.0.1) Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) Collecting setuptools>=21.0.0 (from kubernetes==11.0.0->mtc==0.0.1) Using cached setuptools-80.10.2-py3-none-any.whl.metadata (6.6 kB) Requirement already satisfied: pyyaml>=3.12 in /alabama/venv/lib64/python3.12/site-packages (from kubernetes==11.0.0->mtc==0.0.1) (6.0.3) Collecting google-auth>=1.0.1 (from kubernetes==11.0.0->mtc==0.0.1) Downloading google_auth-2.48.0-py3-none-any.whl.metadata (6.2 kB) Collecting websocket-client!=0.40.0,!=0.41.*,!=0.42.*,>=0.32.0 (from kubernetes==11.0.0->mtc==0.0.1) Downloading websocket_client-1.9.0-py3-none-any.whl.metadata (8.3 kB) Collecting requests-oauthlib (from kubernetes==11.0.0->mtc==0.0.1) Downloading requests_oauthlib-2.0.0-py2.py3-none-any.whl.metadata (11 kB) Collecting urllib3>=1.24.2 (from kubernetes==11.0.0->mtc==0.0.1) Downloading urllib3-2.6.3-py3-none-any.whl.metadata (6.9 kB) Collecting python-string-utils (from openshift==0.11.2->mtc==0.0.1) Downloading python_string_utils-1.0.0-py3-none-any.whl.metadata (12 kB) Collecting ruamel.yaml>=0.15 (from openshift==0.11.2->mtc==0.0.1) Downloading ruamel_yaml-0.19.1-py3-none-any.whl.metadata (16 kB) Collecting MarkupSafe>=2.0 (from jinja2->mtc==0.0.1) Downloading markupsafe-3.0.3-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (2.7 kB) Collecting charset_normalizer<4,>=2 (from requests->mtc==0.0.1) Downloading charset_normalizer-3.4.4-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (37 kB) Collecting idna<4,>=2.5 (from requests->mtc==0.0.1) Downloading idna-3.11-py3-none-any.whl.metadata (8.4 kB) Collecting pyasn1-modules>=0.2.1 (from google-auth>=1.0.1->kubernetes==11.0.0->mtc==0.0.1) Downloading pyasn1_modules-0.4.2-py3-none-any.whl.metadata (3.5 kB) Collecting cryptography>=38.0.3 (from google-auth>=1.0.1->kubernetes==11.0.0->mtc==0.0.1) Downloading cryptography-46.0.4-cp311-abi3-manylinux_2_34_x86_64.whl.metadata (5.7 kB) Collecting rsa<5,>=3.1.4 (from google-auth>=1.0.1->kubernetes==11.0.0->mtc==0.0.1) Downloading rsa-4.9.1-py3-none-any.whl.metadata (5.6 kB) Collecting oauthlib>=3.0.0 (from requests-oauthlib->kubernetes==11.0.0->mtc==0.0.1) Downloading oauthlib-3.3.1-py3-none-any.whl.metadata (7.9 kB) Collecting cffi>=2.0.0 (from cryptography>=38.0.3->google-auth>=1.0.1->kubernetes==11.0.0->mtc==0.0.1) Downloading cffi-2.0.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (2.6 kB) Collecting pyasn1<0.7.0,>=0.6.1 (from pyasn1-modules>=0.2.1->google-auth>=1.0.1->kubernetes==11.0.0->mtc==0.0.1) Downloading pyasn1-0.6.2-py3-none-any.whl.metadata (8.4 kB) Collecting pycparser (from cffi>=2.0.0->cryptography>=38.0.3->google-auth>=1.0.1->kubernetes==11.0.0->mtc==0.0.1) Downloading pycparser-3.0-py3-none-any.whl.metadata (8.2 kB) Downloading kubernetes-11.0.0-py3-none-any.whl (1.5 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.5/1.5 MB 8.7 MB/s eta 0:00:00 Downloading jinja2-3.1.6-py3-none-any.whl (134 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 134.9/134.9 kB 1.0 MB/s eta 0:00:00 Downloading requests-2.32.5-py3-none-any.whl (64 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64.7/64.7 kB 451.8 kB/s eta 0:00:00 Downloading suds_py3-1.4.5.0-py3-none-any.whl (298 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 298.8/298.8 kB 2.6 MB/s eta 0:00:00 Downloading certifi-2026.1.4-py3-none-any.whl (152 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 152.9/152.9 kB 1.2 MB/s eta 0:00:00 Downloading charset_normalizer-3.4.4-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (153 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 153.5/153.5 kB 1.0 MB/s eta 0:00:00 Downloading google_auth-2.48.0-py3-none-any.whl (236 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 236.5/236.5 kB 2.1 MB/s eta 0:00:00 Downloading idna-3.11-py3-none-any.whl (71 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 71.0/71.0 kB 718.0 kB/s eta 0:00:00 Downloading markupsafe-3.0.3-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (22 kB) Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 229.9/229.9 kB 4.3 MB/s eta 0:00:00 Downloading ruamel_yaml-0.19.1-py3-none-any.whl (118 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 118.1/118.1 kB 2.0 MB/s eta 0:00:00 Using cached setuptools-80.10.2-py3-none-any.whl (1.1 MB) Downloading six-1.17.0-py2.py3-none-any.whl (11 kB) Downloading urllib3-2.6.3-py3-none-any.whl (131 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 131.6/131.6 kB 2.8 MB/s eta 0:00:00 Downloading websocket_client-1.9.0-py3-none-any.whl (82 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 82.6/82.6 kB 914.7 kB/s eta 0:00:00 Downloading python_string_utils-1.0.0-py3-none-any.whl (26 kB) Downloading requests_oauthlib-2.0.0-py2.py3-none-any.whl (24 kB) Downloading cryptography-46.0.4-cp311-abi3-manylinux_2_34_x86_64.whl (4.5 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.5/4.5 MB 34.6 MB/s eta 0:00:00 Downloading oauthlib-3.3.1-py3-none-any.whl (160 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 160.1/160.1 kB 2.3 MB/s eta 0:00:00 Downloading pyasn1_modules-0.4.2-py3-none-any.whl (181 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 181.3/181.3 kB 2.6 MB/s eta 0:00:00 Downloading rsa-4.9.1-py3-none-any.whl (34 kB) Downloading cffi-2.0.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (219 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 219.6/219.6 kB 4.4 MB/s eta 0:00:00 Downloading pyasn1-0.6.2-py3-none-any.whl (83 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 83.4/83.4 kB 776.0 kB/s eta 0:00:00 Downloading pycparser-3.0-py3-none-any.whl (48 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48.2/48.2 kB 385.3 kB/s eta 0:00:00 Building wheels for collected packages: mtc, openshift Building wheel for mtc (pyproject.toml): started Building wheel for mtc (pyproject.toml): finished with status 'done' Created wheel for mtc: filename=mtc-0.0.1-py3-none-any.whl size=31145 sha256=d2820b7671d6782e39ca51e63bcea6fdf2a0e119a641c6d089adc85fe4f82268 Stored in directory: /tmp/pip-ephem-wheel-cache-fepbdcsj/wheels/f1/2c/83/c09cb54cb0e821a8186cf5320758c27e7227ec862045210509 Building wheel for openshift (pyproject.toml): started Building wheel for openshift (pyproject.toml): finished with status 'done' Created wheel for openshift: filename=openshift-0.11.2-py3-none-any.whl size=19882 sha256=3ec24d9352bd6dbcdfc3ce905a09e0ffb08c362a8a82f42b1b43173f4880ab28 Stored in directory: /alabama/.cache/pip/wheels/34/b7/02/4eb142942314b119c5fb3d4e595ac59486c1f3d79ff665397d Successfully built mtc openshift Installing collected packages: suds-py3, websocket-client, urllib3, six, setuptools, ruamel.yaml, python-string-utils, pycparser, pyasn1, oauthlib, MarkupSafe, idna, charset_normalizer, certifi, rsa, requests, python-dateutil, pyasn1-modules, jinja2, cffi, requests-oauthlib, cryptography, google-auth, kubernetes, openshift, mtc Successfully installed MarkupSafe-3.0.3 certifi-2026.1.4 cffi-2.0.0 charset_normalizer-3.4.4 cryptography-46.0.4 google-auth-2.48.0 idna-3.11 jinja2-3.1.6 kubernetes-11.0.0 mtc-0.0.1 oauthlib-3.3.1 openshift-0.11.2 pyasn1-0.6.2 pyasn1-modules-0.4.2 pycparser-3.0 python-dateutil-2.9.0.post0 python-string-utils-1.0.0 requests-2.32.5 requests-oauthlib-2.0.0 rsa-4.9.1 ruamel.yaml-0.19.1 setuptools-80.10.2 six-1.17.0 suds-py3-1.4.5.0 urllib3-2.6.3 websocket-client-1.9.0 [notice] A new release of pip is available: 23.3.2 -> 26.0.1 [notice] To update, run: pip install --upgrade pip go: downloading go1.24.1 (linux/amd64) go: downloading github.com/onsi/gomega v1.36.3 go: downloading github.com/onsi/ginkgo/v2 v2.23.4 go: downloading github.com/openshift/oadp-operator v1.0.2-0.20250905181452-1d0b40b2ed49 go: downloading github.com/vmware-tanzu/velero v1.16.0 go: downloading k8s.io/apimachinery v0.31.3 go: downloading github.com/google/uuid v1.6.0 go: downloading k8s.io/api v0.31.3 go: downloading sigs.k8s.io/controller-runtime v0.19.3 go: downloading github.com/operator-framework/api v0.14.1-0.20220413143725-33310d6154f3 go: downloading github.com/migtools/oadp-non-admin v0.0.0-20250409143544-08533a6c302d go: downloading k8s.io/client-go v0.31.3 go: downloading k8s.io/utils v0.0.0-20240711033017-18e509b52bc8 go: downloading github.com/andygrunwald/go-jira v1.16.0 go: downloading github.com/aws/aws-sdk-go v1.44.253 go: downloading github.com/kubernetes-csi/external-snapshotter/client/v4 v4.2.0 go: downloading github.com/apenella/go-ansible v1.1.5 go: downloading gopkg.in/yaml.v2 v2.4.0 go: downloading github.com/openshift/api v0.0.0-20230414143018-3367bc7e6ac7 go: downloading k8s.io/kubectl v0.30.5 go: downloading github.com/openshift/client-go v0.0.0-20211209144617-7385dd6338e3 go: downloading sigs.k8s.io/yaml v1.4.0 go: downloading github.com/google/go-cmp v0.7.0 go: downloading github.com/evanphx/json-patch/v5 v5.9.0 go: downloading k8s.io/klog/v2 v2.130.1 go: downloading github.com/evanphx/json-patch v5.6.0+incompatible go: downloading github.com/go-logr/logr v1.4.2 go: downloading github.com/gogo/protobuf v1.3.2 go: downloading sigs.k8s.io/structured-merge-diff/v4 v4.4.1 go: downloading github.com/google/gofuzz v1.2.0 go: downloading gopkg.in/inf.v0 v0.9.1 go: downloading github.com/spf13/pflag v1.0.6-0.20210604193023-d5e0c0615ace go: downloading github.com/fatih/structs v1.1.0 go: downloading github.com/golang-jwt/jwt/v4 v4.5.0 go: downloading github.com/google/go-querystring v1.1.0 go: downloading github.com/pkg/errors v0.9.1 go: downloading github.com/trivago/tgo v1.0.7 go: downloading github.com/sirupsen/logrus v1.9.3 go: downloading github.com/apenella/go-common-utils/data v0.0.0-20210528133155-34ba915e28c8 go: downloading github.com/apenella/go-common-utils/error v0.0.0-20210528133155-34ba915e28c8 go: downloading github.com/imdario/mergo v0.3.13 go: downloading golang.org/x/term v0.32.0 go: downloading golang.org/x/net v0.41.0 go: downloading github.com/gorilla/websocket v1.5.0 go: downloading gopkg.in/yaml.v3 v3.0.1 go: downloading sigs.k8s.io/json v0.0.0-20221116044647-bc3834ca7abd go: downloading k8s.io/kube-openapi v0.0.0-20240228011516-70dd3763d340 go: downloading k8s.io/apiextensions-apiserver v0.31.3 go: downloading golang.org/x/exp v0.0.0-20240719175910-8a7402abbf56 go: downloading gopkg.in/evanphx/json-patch.v4 v4.12.0 go: downloading go.uber.org/automaxprocs v1.6.0 go: downloading golang.org/x/sys v0.33.0 go: downloading github.com/json-iterator/go v1.1.12 go: downloading github.com/spf13/cobra v1.8.1 go: downloading k8s.io/cli-runtime v0.31.3 go: downloading k8s.io/component-base v0.31.3 go: downloading github.com/blang/semver/v4 v4.0.0 go: downloading github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da go: downloading github.com/golang/protobuf v1.5.4 go: downloading github.com/google/gnostic-models v0.6.8 go: downloading google.golang.org/protobuf v1.36.5 go: downloading golang.org/x/time v0.9.0 go: downloading golang.org/x/oauth2 v0.27.0 go: downloading github.com/moby/spdystream v0.4.0 go: downloading github.com/davecgh/go-spew v1.1.2-0.20180830191138-d8f796af33cc go: downloading golang.org/x/text v0.26.0 go: downloading github.com/stretchr/testify v1.10.0 go: downloading gopkg.in/check.v1 v1.0.0-20201130134442-10cb98267c6c go: downloading github.com/go-logr/zapr v1.3.0 go: downloading go.uber.org/zap v1.27.0 go: downloading go.uber.org/goleak v1.3.0 go: downloading github.com/armon/go-socks5 v0.0.0-20160902184237-e75332964ef5 go: downloading github.com/go-openapi/jsonreference v0.20.2 go: downloading github.com/go-openapi/swag v0.22.4 go: downloading github.com/go-task/slim-sprig/v3 v3.0.0 go: downloading golang.org/x/tools v0.33.0 go: downloading github.com/fxamacker/cbor/v2 v2.7.0 go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd go: downloading github.com/modern-go/reflect2 v1.0.2 go: downloading github.com/kubernetes-csi/external-snapshotter/client/v7 v7.0.0 go: downloading github.com/aws/aws-sdk-go-v2 v1.30.3 go: downloading github.com/aws/aws-sdk-go-v2/config v1.26.3 go: downloading github.com/aws/aws-sdk-go-v2/service/s3 v1.48.0 go: downloading github.com/aws/aws-sdk-go-v2/feature/s3/manager v1.15.11 go: downloading github.com/inconshreveable/mousetrap v1.1.0 go: downloading github.com/jonboulle/clockwork v0.2.2 go: downloading k8s.io/component-helpers v0.30.5 go: downloading github.com/daviddengcn/go-colortext v1.0.0 go: downloading github.com/liggitt/tabwriter v0.0.0-20181228230101-89fcab3d43de go: downloading github.com/distribution/reference v0.5.0 go: downloading github.com/moby/term v0.5.0 go: downloading github.com/fvbommel/sortorder v1.1.0 go: downloading sigs.k8s.io/kustomize/kustomize/v5 v5.0.4-0.20230601165947-6ce0bf390ce3 go: downloading sigs.k8s.io/kustomize/kyaml v0.17.1 go: downloading github.com/exponent-io/jsonpath v0.0.0-20151013193312-d6023ce2651d go: downloading github.com/lithammer/dedent v1.1.0 go: downloading k8s.io/metrics v0.31.3 go: downloading github.com/chai2010/gettext-go v1.0.2 go: downloading github.com/MakeNowJust/heredoc v1.0.0 go: downloading github.com/mitchellh/go-wordwrap v1.0.1 go: downloading github.com/russross/blackfriday/v2 v2.1.0 go: downloading github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822 go: downloading github.com/mxk/go-flowrate v0.0.0-20140419014527-cca7078d478f go: downloading github.com/kr/pretty v0.3.1 go: downloading github.com/pmezard/go-difflib v1.0.1-0.20181226105442-5d4384ee4fb2 go: downloading github.com/google/pprof v0.0.0-20250403155104-27863c87afa6 go: downloading github.com/go-openapi/jsonpointer v0.19.6 go: downloading github.com/mailru/easyjson v0.7.7 go: downloading go.uber.org/multierr v1.11.0 go: downloading github.com/spf13/afero v1.10.0 go: downloading github.com/x448/float16 v0.8.4 go: downloading github.com/aws/smithy-go v1.20.3 go: downloading golang.org/x/sync v0.15.0 go: downloading sigs.k8s.io/kustomize/api v0.17.2 go: downloading github.com/aws/aws-sdk-go-v2/credentials v1.17.26 go: downloading github.com/aws/aws-sdk-go-v2/feature/ec2/imds v1.16.11 go: downloading github.com/aws/aws-sdk-go-v2/internal/ini v1.8.0 go: downloading github.com/aws/aws-sdk-go-v2/service/sso v1.22.3 go: downloading github.com/aws/aws-sdk-go-v2/service/ssooidc v1.26.4 go: downloading github.com/aws/aws-sdk-go-v2/service/sts v1.30.3 go: downloading github.com/fatih/camelcase v1.0.0 go: downloading github.com/aws/aws-sdk-go-v2/aws/protocol/eventstream v1.5.4 go: downloading github.com/aws/aws-sdk-go-v2/internal/configsources v1.3.15 go: downloading github.com/aws/aws-sdk-go-v2/internal/v4a v1.2.10 go: downloading github.com/aws/aws-sdk-go-v2/service/internal/accept-encoding v1.11.3 go: downloading github.com/aws/aws-sdk-go-v2/service/internal/checksum v1.2.10 go: downloading github.com/aws/aws-sdk-go-v2/service/internal/presigned-url v1.11.17 go: downloading github.com/aws/aws-sdk-go-v2/service/internal/s3shared v1.16.10 go: downloading github.com/opencontainers/go-digest v1.0.0 go: downloading github.com/creack/pty v1.1.18 go: downloading github.com/golangplus/testing v1.0.0 go: downloading github.com/gregjones/httpcache v0.0.0-20180305231024-9cad4c3443a7 go: downloading github.com/peterbourgon/diskv v2.0.1+incompatible go: downloading github.com/emicklei/go-restful/v3 v3.11.0 go: downloading github.com/kr/text v0.2.0 go: downloading github.com/rogpeppe/go-internal v1.12.0 go: downloading github.com/prashantv/gostub v1.1.0 go: downloading github.com/prometheus/client_golang v1.20.5 go: downloading github.com/stretchr/objx v0.5.2 go: downloading github.com/josharian/intern v1.0.0 go: downloading github.com/aws/aws-sdk-go-v2/internal/endpoints/v2 v2.6.15 go: downloading github.com/jmespath/go-jmespath v0.4.0 go: downloading github.com/Azure/go-ansiterm v0.0.0-20210617225240-d185dfc1b5a1 go: downloading github.com/go-errors/errors v1.4.2 go: downloading gomodules.xyz/jsonpatch/v2 v2.4.0 go: downloading github.com/prometheus/client_model v0.6.1 go: downloading github.com/google/btree v1.0.1 go: downloading github.com/sergi/go-diff v1.2.0 go: downloading github.com/monochromegane/go-gitignore v0.0.0-20200626010858-205db1a8cc00 go: downloading github.com/xlab/treeprint v1.2.0 go: downloading github.com/google/shlex v0.0.0-20191202100458-e7afc7fbc510 go: downloading go.starlark.net v0.0.0-20230525235612-a134d8f9ddca go: downloading github.com/prometheus/procfs v0.15.1 go: downloading github.com/prometheus/common v0.62.0 go: downloading github.com/klauspost/compress v1.17.11 go: downloading github.com/cespare/xxhash/v2 v2.3.0 go: downloading github.com/kylelemons/godebug v1.1.0 go: downloading github.com/beorn7/perks v1.0.1 go: downloading github.com/jmespath/go-jmespath/internal/testify v1.5.1 storageclass.storage.k8s.io/gp2-csi annotated storageclass.storage.k8s.io/gp3-csi annotated storageclass.storage.k8s.io/odf-operator-ceph-rbd annotated storageclass.storage.k8s.io/odf-operator-ceph-rbd-virtualization annotated storageclass.storage.k8s.io/odf-operator-cephfs annotated storageclass.storage.k8s.io/openshift-storage.noobaa.io annotated storageclass.storage.k8s.io/odf-operator-ceph-rbd annotated + readonly 'RED=\e[31m' + RED='\e[31m' + readonly 'BLUE=\033[34m' + BLUE='\033[34m' + readonly 'CLEAR=\e[39m' + CLEAR='\e[39m' ++ oc get infrastructures cluster -o 'jsonpath={.status.platform}' ++ awk '{print tolower($0)}' + CLOUD_PROVIDER=aws + [[ '' == \t\r\u\e ]] + echo /home/jenkins/.kube/config /home/jenkins/.kube/config + [[ aws == *-arm* ]] + [[ aws == *-fips* ]] + E2E_TIMEOUT_MULTIPLIER=2 + export NAMESPACE=openshift-adp + NAMESPACE=openshift-adp + export PROVIDER=aws + PROVIDER=aws ++ echo aws ++ awk '{print tolower($0)}' + BACKUP_LOCATION=aws + export BACKUP_LOCATION=aws + BACKUP_LOCATION=aws + export BUCKET=ci-op-988mlksm-interopoadp + BUCKET=ci-op-988mlksm-interopoadp + OADP_CREDS_FILE=/tmp/test-settings/credentials + OADP_VSL_CREDS_FILE=/tmp/test-settings/aws_vsl_creds +++ readlink -f /alabama/cspi/test_settings/scripts/test_runner.sh ++ dirname /alabama/cspi/test_settings/scripts/test_runner.sh + readonly SCRIPT_DIR=/alabama/cspi/test_settings/scripts + SCRIPT_DIR=/alabama/cspi/test_settings/scripts ++ cd /alabama/cspi/test_settings/scripts ++ git rev-parse --show-toplevel + readonly TOP_DIR=/alabama/cspi + TOP_DIR=/alabama/cspi + echo /alabama/cspi /alabama/cspi + TESTS_FOLDER=/alabama/cspi/e2e/kubevirt-plugin ++ oc get nodes -o 'jsonpath={.items[*].metadata.labels.kubernetes\.io/arch}' ++ tr ' ' '\n' ++ sort -u ++ xargs + export NODES_ARCHITECTURE=amd64 + NODES_ARCHITECTURE=amd64 + export OADP_REPOSITORY=redhat + OADP_REPOSITORY=redhat + SKIP_DPA_CREATION=false ++ oc get ns openshift-storage ++ echo true + OPENSHIFT_STORAGE=true + '[' redhat == upstream-velero ']' + '[' true == true ']' ++ oc get sc ++ awk '$1 ~ /^.+ceph-rbd$/ {print $1}' ++ tail -1 + CEPH_RBD_STORAGE_CLASS=odf-operator-ceph-rbd + '[' -n odf-operator-ceph-rbd ']' + export CEPH_RBD_STORAGE_CLASS + echo 'ceph-rbd StorageClass found: odf-operator-ceph-rbd' ceph-rbd StorageClass found: odf-operator-ceph-rbd ++ oc get storageclass -o 'jsonpath={range .items[*]}{@.metadata.name}{" "}{@.metadata.annotations.storageclass\.kubernetes\.io/is-default-class}{"\n"}{end}' ++ awk '$2=="true"{print $1}' ++ wc -l + NUM_DEFAULT_STORAGE_CLASS=1 + '[' 1 -ne 1 ']' ++ oc get storageclass -o 'jsonpath={.items[?(@.metadata.annotations.storageclass\.kubernetes\.io/is-default-class=='\''true'\'')].metadata.name}' + DEFAULT_SC=odf-operator-ceph-rbd + export STORAGE_CLASS=odf-operator-ceph-rbd + STORAGE_CLASS=odf-operator-ceph-rbd + '[' -n odf-operator-ceph-rbd ']' + '[' odf-operator-ceph-rbd '!=' odf-operator-ceph-rbd ']' + export STORAGE_CLASS_OPENSHIFT_STORAGE=odf-operator-ceph-rbd + STORAGE_CLASS_OPENSHIFT_STORAGE=odf-operator-ceph-rbd + echo 'Using the StorageClass for openshift-storage: odf-operator-ceph-rbd' Using the StorageClass for openshift-storage: odf-operator-ceph-rbd + [[ amd64 != \a\m\d\6\4 ]] + TEST_FILTER='!// || (// && !exclude_aws && (!/target/ || target_aws) ) ' + [[ aws =~ ^(osp|vsphere|gcp-wif|ibmcloud|azure-sts|aro-4) ]] + [[ aws =~ ^azure_sak ]] ++ oc config current-context ++ awk -F / '{print $2}' + SETTINGS_TMP=/alabama/cspi/output_files/api-ci-op-988mlksm-2c502-cspilp-interop-ccitredhat-com:6443 + mkdir -p /alabama/cspi/output_files/api-ci-op-988mlksm-2c502-cspilp-interop-ccitredhat-com:6443 ++ oc get authentication cluster -o 'jsonpath={.spec.serviceAccountIssuer}' + IS_OIDC= + '[' '!' -z ']' + [[ aws == \a\w\s ]] + export PROVIDER=aws + PROVIDER=aws + export CREDS_SECRET_REF=cloud-credentials + CREDS_SECRET_REF=cloud-credentials ++ oc get infrastructures cluster -o 'jsonpath={.status.platformStatus.aws.region}' --allow-missing-template-keys=false + export REGION=us-east-2 + REGION=us-east-2 + settings_script=aws_settings.sh + '[' aws == aws-sts ']' + BUCKET=ci-op-988mlksm-interopoadp + TMP_DIR=/alabama/cspi/output_files/api-ci-op-988mlksm-2c502-cspilp-interop-ccitredhat-com:6443 + source /alabama/cspi/test_settings/scripts/aws_settings.sh ++ cat ++ [[ aws == *aws* ]] ++ cat ++ echo -e '\n }\n}' +++ cat /alabama/cspi/output_files/api-ci-op-988mlksm-2c502-cspilp-interop-ccitredhat-com:6443/settings.json ++ x='{ "metadata": { "namespace": "openshift-adp" }, "spec": { "configuration":{ "velero":{ "defaultPlugins": [ "openshift", "aws" ] } }, "backupLocations": [ { "velero": { "provider": "aws", "default": true, "config": { "region": "us-east-2" }, "credential":{ "name": "cloud-credentials", "key": "cloud" }, "objectStorage":{ "bucket": "ci-op-988mlksm-interopoadp" } } } ] , "snapshotLocations": [ { "velero": { "provider": "aws", "config": { "profile": "default", "region": "us-east-2" } } } ] } }' ++ echo '{ "metadata": { "namespace": "openshift-adp" }, "spec": { "configuration":{ "velero":{ "defaultPlugins": [ "openshift", "aws" ] } }, "backupLocations": [ { "velero": { "provider": "aws", "default": true, "config": { "region": "us-east-2" }, "credential":{ "name": "cloud-credentials", "key": "cloud" }, "objectStorage":{ "bucket": "ci-op-988mlksm-interopoadp" } } } ] , "snapshotLocations": [ { "velero": { "provider": "aws", "config": { "profile": "default", "region": "us-east-2" } } } ] } }' ++ grep -o '^[^#]*' + FILE_SETTINGS_NAME=settings.json + printf '\033[34mGenerated settings file under /alabama/cspi/output_files/api-ci-op-988mlksm-2c502-cspilp-interop-ccitredhat-com:6443/settings.json\e[39m\n' Generated settings file under /alabama/cspi/output_files/api-ci-op-988mlksm-2c502-cspilp-interop-ccitredhat-com:6443/settings.json + cat /alabama/cspi/output_files/api-ci-op-988mlksm-2c502-cspilp-interop-ccitredhat-com:6443/settings.json ++ oc get volumesnapshotclass -o name + for i in $(oc get volumesnapshotclass -o name) + oc annotate volumesnapshotclass.snapshot.storage.k8s.io/csi-aws-vsc snapshot.storage.kubernetes.io/is-default-class- volumesnapshotclass.snapshot.storage.k8s.io/csi-aws-vsc annotated + for i in $(oc get volumesnapshotclass -o name) + oc annotate volumesnapshotclass.snapshot.storage.k8s.io/odf-operator-cephfsplugin-snapclass snapshot.storage.kubernetes.io/is-default-class- volumesnapshotclass.snapshot.storage.k8s.io/odf-operator-cephfsplugin-snapclass annotated + for i in $(oc get volumesnapshotclass -o name) + oc annotate volumesnapshotclass.snapshot.storage.k8s.io/odf-operator-rbdplugin-snapclass snapshot.storage.kubernetes.io/is-default-class- volumesnapshotclass.snapshot.storage.k8s.io/odf-operator-rbdplugin-snapclass annotated ++ ./e2e/must-gather/get-latest-build.sh + oc get configmaps -n default must-gather-image + UPSTREAM_VERSION=99.0.0 ++ oc get OperatorCondition -n openshift-adp -o 'jsonpath={.items[*].metadata.name}' ++ awk -F v '{print $2}' + OADP_VERSION=1.5.3 + '[' -z 1.5.3 ']' + '[' 1.5.3 == 99.0.0 ']' ++ oc get sub redhat-oadp-operator -n openshift-adp -o 'jsonpath={.spec.source}' + OADP_REPO=redhat-operators + '[' -z redhat-operators ']' + '[' redhat-operators == redhat-operators ']' + REGISTRY_PATH=registry.redhat.io/oadp/oadp-mustgather-rhel9: + TAG=1.5.3 + export MUST_GATHER_BUILD=registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 + MUST_GATHER_BUILD=registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 + echo registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 + export MUST_GATHER_BUILD=registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 + MUST_GATHER_BUILD=registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 + '[' -z registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 ']' + export NUM_OF_OADP_INSTANCES=1 + NUM_OF_OADP_INSTANCES=1 ++ echo --skip=tc-id:OADP-555 ++ tr ' ' '\n' ++ grep '^--' ++ tr '\n' ' ' + GINKO_PARAM='--skip=tc-id:OADP-555 ' ++ echo --skip=tc-id:OADP-555 ++ tr ' ' '\n' ++ grep '^-' ++ grep -v '^--' ++ tr '\n' ' ' + TEST_PARAM= + ginkgo run --nodes=1 -mod=mod --show-node-events --flake-attempts 3 --junit-report=/logs/artifacts/junit_oadp_cnv_results.xml '--label-filter=!// || (// && !exclude_aws && (!/target/ || target_aws) ) ' --skip=tc-id:OADP-555 -p /alabama/cspi/e2e/kubevirt-plugin/ -- -credentials_file=/tmp/test-settings/credentials -vsl_credentials_file=/tmp/test-settings/aws_vsl_creds -oadp_namespace=openshift-adp -settings=/alabama/cspi/output_files/api-ci-op-988mlksm-2c502-cspilp-interop-ccitredhat-com:6443/settings.json -must_gather_image=registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 -timeout_multiplier=2 -skip_dpa_creation=false Ginkgo detected a version mismatch between the Ginkgo CLI and the version of Ginkgo imported by your packages: Ginkgo CLI Version: 2.28.1 Mismatched package versions found: 2.23.4 used by kubevirt-plugin Ginkgo will continue to attempt to run but you may see errors (including flag parsing errors) and should either update your go.mod or your version of the Ginkgo CLI to match. To install the matching version of the CLI run go install github.com/onsi/ginkgo/v2/ginkgo from a path that contains a go.mod file. Alternatively you can use go run github.com/onsi/ginkgo/v2/ginkgo from a path that contains a go.mod file to invoke the matching version of the Ginkgo CLI. If you are attempting to test multiple packages that each have a different version of the Ginkgo library with a single Ginkgo CLI that is currently unsupported.  2026/02/05 16:27:45 Setting up clients 2026/02/05 16:27:45 Getting default StorageClass... 2026/02/05 16:27:45 Checking default storage class count Run the command: oc get sc 2026/02/05 16:27:45 Got default StorageClass odf-operator-ceph-rbd 2026/02/05 16:27:45 oc get sc NAME PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE gp2-csi ebs.csi.aws.com Delete WaitForFirstConsumer true 55m gp3-csi ebs.csi.aws.com Delete WaitForFirstConsumer true 55m odf-operator-ceph-rbd (default) openshift-storage.rbd.csi.ceph.com Delete Immediate true 6m38s odf-operator-ceph-rbd-virtualization openshift-storage.rbd.csi.ceph.com Delete Immediate true 6m38s odf-operator-cephfs openshift-storage.cephfs.csi.ceph.com Delete Immediate true 6m38s openshift-storage.noobaa.io openshift-storage.noobaa.io/obc Delete Immediate false 2m36s 2026/02/05 16:27:45 Using velero prefix: velero-e2e-kubevirt-9a089028-02af-11f1-a828-0a58ac1896e8 Running Suite: OADP E2E Virtualization Workloads Suite - /alabama/cspi/e2e/kubevirt-plugin ========================================================================================== Random Seed: 1770308823 Will run 4 of 5 specs ------------------------------ [BeforeSuite]  /alabama/cspi/e2e/kubevirt-plugin/kubevirt_suite_test.go:62 > Enter [BeforeSuite] TOP-LEVEL @ 02/05/26 16:27:45.199 < Exit [BeforeSuite] TOP-LEVEL @ 02/05/26 16:27:45.224 (25ms) [BeforeSuite] PASSED [0.025 seconds] ------------------------------ S ------------------------------ Native CSI Data Mover: Backup/Restore Openshift Virtualization Workloads  [tc-id:OADP-401] [kubevirt] [Tier1] Started VM should over ceph filesytem mode /alabama/cspi/e2e/kubevirt-plugin/backup_restore_datamover.go:129 > Enter [JustBeforeEach] TOP-LEVEL @ 02/05/26 16:27:45.225 < Exit [JustBeforeEach] TOP-LEVEL @ 02/05/26 16:27:45.225 (0s) > Enter [It] [tc-id:OADP-401] [kubevirt] [Tier1] Started VM should over ceph filesytem mode @ 02/05/26 16:27:45.225 2026/02/05 16:27:45 Delete all downloadrequest No download requests are found STEP: Create DPA CR @ 02/05/26 16:27:45.232 2026/02/05 16:27:45 native-datamover 2026/02/05 16:27:45 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "f104df50-9eab-4072-8100-ac4ebbbbb9d1", "resourceVersion": "68791", "generation": 1, "creationTimestamp": "2026-02-05T16:27:45Z", "managedFields": [ { "manager": "kubevirt-plugin.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T16:27:45Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:nodeAgent": { ".": {}, "f:enable": {}, "f:podConfig": { ".": {}, "f:resourceAllocations": {} }, "f:uploaderType": {} }, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "kubevirt" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false }, "nodeAgent": { "enable": true, "podConfig": { "resourceAllocations": {} }, "uploaderType": "kopia" } }, "features": null, "logFormat": "text" }, "status": {} } Delete all the backups that remained in the phase InProgress Deleting backup CRs in progress Deletion of backup CRs in progress completed Delete all the restores that remained in the phase InProgress Deleting restore CRs in progress Deletion of restore CRs in progress completed STEP: Verify DPA CR setup @ 02/05/26 16:27:45.264 2026/02/05 16:27:45 Waiting for velero pod to be running 2026/02/05 16:27:50 pod: velero-6c5c458f58-t4zcm is not yet running with status: {Pending [{PodReadyToStartContainers False 0001-01-01 00:00:00 +0000 UTC 2026-02-05 16:27:45 +0000 UTC } {Initialized False 0001-01-01 00:00:00 +0000 UTC 2026-02-05 16:27:45 +0000 UTC ContainersNotInitialized containers with incomplete status: [openshift-velero-plugin velero-plugin-for-aws kubevirt-velero-plugin hypershift-oadp-plugin]} {Ready False 0001-01-01 00:00:00 +0000 UTC 2026-02-05 16:27:45 +0000 UTC ContainersNotReady containers with unready status: [velero]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2026-02-05 16:27:45 +0000 UTC ContainersNotReady containers with unready status: [velero]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2026-02-05 16:27:45 +0000 UTC }] 10.0.60.83 [{10.0.60.83}] [] 2026-02-05 16:27:45 +0000 UTC [{openshift-velero-plugin {&ContainerStateWaiting{Reason:PodInitializing,Message:,} nil nil} {nil nil nil} false 0 registry.redhat.io/oadp/oadp-velero-plugin-rhel9@sha256:9b888c75a1ddf274b1f0aa053ddbbc9acc3270417712456ffa29ef81a883b38a 0xc00086a2ca map[] nil [{plugins /target false } {kube-api-access-7sznb /var/run/secrets/kubernetes.io/serviceaccount true 0xc000b49900}] nil []} {velero-plugin-for-aws {&ContainerStateWaiting{Reason:PodInitializing,Message:,} nil nil} {nil nil nil} false 0 registry.redhat.io/oadp/oadp-velero-plugin-for-aws-rhel9@sha256:2a099649d3d7101a0b6dff9f6372bc76903ba6ecb6578dbeef8a8b3853f48026 0xc00086a308 map[] nil [{plugins /target false } {kube-api-access-7sznb /var/run/secrets/kubernetes.io/serviceaccount true 0xc000b49910}] nil []} {kubevirt-velero-plugin {&ContainerStateWaiting{Reason:PodInitializing,Message:,} nil nil} {nil nil nil} false 0 registry.redhat.io/oadp/oadp-kubevirt-velero-plugin-rhel9@sha256:77d6057b1783872ec65d7d6a88d8a1212c38aacc982c7efd46ed2eb77b5e9e70 0xc00086a33f map[] nil [{plugins /target false } {kube-api-access-7sznb /var/run/secrets/kubernetes.io/serviceaccount true 0xc000b49920}] nil []} {hypershift-oadp-plugin {&ContainerStateWaiting{Reason:PodInitializing,Message:,} nil nil} {nil nil nil} false 0 registry.redhat.io/oadp/oadp-hypershift-velero-plugin-rhel9@sha256:f8798364f94bb1bf4db264b0439c5a280b40cafa408c47b4160d9cc9c5d87e53 0xc00086a358 map[] nil [{plugins /target false } {kube-api-access-7sznb /var/run/secrets/kubernetes.io/serviceaccount true 0xc000b49930}] nil []}] [{velero {&ContainerStateWaiting{Reason:PodInitializing,Message:,} nil nil} {nil nil nil} false 0 registry.redhat.io/oadp/oadp-velero-rhel9@sha256:dd5897b1579599cfa8d8a03a1c8d3cf68e3927c4ba5dee4e33c2a2d4c9e6ed89 0xc00086a386 map[] nil [{plugins /plugins false } {scratch /scratch false } {certs /etc/ssl/certs false } {bound-sa-token /var/run/secrets/openshift/serviceaccount true 0xc000b49940} {kube-api-access-7sznb /var/run/secrets/kubernetes.io/serviceaccount true 0xc000b49950}] nil []}] Burstable [] []} 2026/02/05 16:27:55 pod: velero-6c5c458f58-t4zcm is not yet running with status: {Pending [{PodReadyToStartContainers True 0001-01-01 00:00:00 +0000 UTC 2026-02-05 16:27:51 +0000 UTC } {Initialized False 0001-01-01 00:00:00 +0000 UTC 2026-02-05 16:27:45 +0000 UTC ContainersNotInitialized containers with incomplete status: [kubevirt-velero-plugin hypershift-oadp-plugin]} {Ready False 0001-01-01 00:00:00 +0000 UTC 2026-02-05 16:27:45 +0000 UTC ContainersNotReady containers with unready status: [velero]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2026-02-05 16:27:45 +0000 UTC ContainersNotReady containers with unready status: [velero]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2026-02-05 16:27:45 +0000 UTC }] 10.0.60.83 [{10.0.60.83}] 10.129.2.77 [{10.129.2.77}] 2026-02-05 16:27:45 +0000 UTC [{openshift-velero-plugin {nil nil &ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2026-02-05 16:27:50 +0000 UTC,FinishedAt:2026-02-05 16:27:51 +0000 UTC,ContainerID:cri-o://0d518ae22b78eeb27459db35bb0788813b9045c2ee61da15704e2e88ad121d61,}} {nil nil nil} true 0 registry.redhat.io/oadp/oadp-velero-plugin-rhel9@sha256:9b888c75a1ddf274b1f0aa053ddbbc9acc3270417712456ffa29ef81a883b38a registry.redhat.io/oadp/oadp-velero-plugin-rhel9@sha256:212589b9f5b75a043c9a7094cb681a39687795c5e78e625beb6d00960ea57e70 cri-o://0d518ae22b78eeb27459db35bb0788813b9045c2ee61da15704e2e88ad121d61 0xc00045d6d9 map[cpu:{{500 -3} {} 500m DecimalSI} memory:{{134217728 0} {} BinarySI}] &ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{134217728 0} {} BinarySI},},Claims:[]ResourceClaim{},} [{plugins /target false } {kube-api-access-7sznb /var/run/secrets/kubernetes.io/serviceaccount true 0xc0002971e0}] &ContainerUser{Linux:&LinuxContainerUser{UID:1000740000,GID:0,SupplementalGroups:[0 1000740000],},} []} {velero-plugin-for-aws {nil nil &ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2026-02-05 16:27:54 +0000 UTC,FinishedAt:2026-02-05 16:27:54 +0000 UTC,ContainerID:cri-o://08e67b995c82e7b1e6c8865a3fe9012be572d2b4a447b3c60abaf05ecbeb0a29,}} {nil nil nil} true 0 registry.redhat.io/oadp/oadp-velero-plugin-for-aws-rhel9@sha256:2a099649d3d7101a0b6dff9f6372bc76903ba6ecb6578dbeef8a8b3853f48026 registry.redhat.io/oadp/oadp-velero-plugin-for-aws-rhel9@sha256:2a099649d3d7101a0b6dff9f6372bc76903ba6ecb6578dbeef8a8b3853f48026 cri-o://08e67b995c82e7b1e6c8865a3fe9012be572d2b4a447b3c60abaf05ecbeb0a29 0xc00045d748 map[cpu:{{500 -3} {} 500m DecimalSI} memory:{{134217728 0} {} BinarySI}] &ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{134217728 0} {} BinarySI},},Claims:[]ResourceClaim{},} [{plugins /target false } {kube-api-access-7sznb /var/run/secrets/kubernetes.io/serviceaccount true 0xc000297380}] &ContainerUser{Linux:&LinuxContainerUser{UID:1000740000,GID:0,SupplementalGroups:[0 1000740000],},} []} {kubevirt-velero-plugin {&ContainerStateWaiting{Reason:PodInitializing,Message:,} nil nil} {nil nil nil} false 0 registry.redhat.io/oadp/oadp-kubevirt-velero-plugin-rhel9@sha256:77d6057b1783872ec65d7d6a88d8a1212c38aacc982c7efd46ed2eb77b5e9e70 0xc00045d7da map[] nil [{plugins /target false } {kube-api-access-7sznb /var/run/secrets/kubernetes.io/serviceaccount true 0xc000297390}] nil []} {hypershift-oadp-plugin {&ContainerStateWaiting{Reason:PodInitializing,Message:,} nil nil} {nil nil nil} false 0 registry.redhat.io/oadp/oadp-hypershift-velero-plugin-rhel9@sha256:f8798364f94bb1bf4db264b0439c5a280b40cafa408c47b4160d9cc9c5d87e53 0xc00045d818 map[] nil [{plugins /target false } {kube-api-access-7sznb /var/run/secrets/kubernetes.io/serviceaccount true 0xc0002973a0}] nil []}] [{velero {&ContainerStateWaiting{Reason:PodInitializing,Message:,} nil nil} {nil nil nil} false 0 registry.redhat.io/oadp/oadp-velero-rhel9@sha256:dd5897b1579599cfa8d8a03a1c8d3cf68e3927c4ba5dee4e33c2a2d4c9e6ed89 0xc00045d846 map[] nil [{plugins /plugins false } {scratch /scratch false } {certs /etc/ssl/certs false } {bound-sa-token /var/run/secrets/openshift/serviceaccount true 0xc0002973b0} {kube-api-access-7sznb /var/run/secrets/kubernetes.io/serviceaccount true 0xc0002973c0}] nil []}] Burstable [] []} 2026/02/05 16:28:00 pod: velero-6c5c458f58-t4zcm is not yet running with status: {Pending [{PodReadyToStartContainers True 0001-01-01 00:00:00 +0000 UTC 2026-02-05 16:27:51 +0000 UTC } {Initialized False 0001-01-01 00:00:00 +0000 UTC 2026-02-05 16:27:45 +0000 UTC ContainersNotInitialized containers with incomplete status: [hypershift-oadp-plugin]} {Ready False 0001-01-01 00:00:00 +0000 UTC 2026-02-05 16:27:45 +0000 UTC ContainersNotReady containers with unready status: [velero]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2026-02-05 16:27:45 +0000 UTC ContainersNotReady containers with unready status: [velero]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2026-02-05 16:27:45 +0000 UTC }] 10.0.60.83 [{10.0.60.83}] 10.129.2.77 [{10.129.2.77}] 2026-02-05 16:27:45 +0000 UTC [{openshift-velero-plugin {nil nil &ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2026-02-05 16:27:50 +0000 UTC,FinishedAt:2026-02-05 16:27:51 +0000 UTC,ContainerID:cri-o://0d518ae22b78eeb27459db35bb0788813b9045c2ee61da15704e2e88ad121d61,}} {nil nil nil} true 0 registry.redhat.io/oadp/oadp-velero-plugin-rhel9@sha256:9b888c75a1ddf274b1f0aa053ddbbc9acc3270417712456ffa29ef81a883b38a registry.redhat.io/oadp/oadp-velero-plugin-rhel9@sha256:212589b9f5b75a043c9a7094cb681a39687795c5e78e625beb6d00960ea57e70 cri-o://0d518ae22b78eeb27459db35bb0788813b9045c2ee61da15704e2e88ad121d61 0xc0008d6309 map[cpu:{{500 -3} {} 500m DecimalSI} memory:{{134217728 0} {} BinarySI}] &ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{134217728 0} {} BinarySI},},Claims:[]ResourceClaim{},} [{plugins /target false } {kube-api-access-7sznb /var/run/secrets/kubernetes.io/serviceaccount true 0xc000c24000}] &ContainerUser{Linux:&LinuxContainerUser{UID:1000740000,GID:0,SupplementalGroups:[0 1000740000],},} []} {velero-plugin-for-aws {nil nil &ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2026-02-05 16:27:54 +0000 UTC,FinishedAt:2026-02-05 16:27:54 +0000 UTC,ContainerID:cri-o://08e67b995c82e7b1e6c8865a3fe9012be572d2b4a447b3c60abaf05ecbeb0a29,}} {nil nil nil} true 0 registry.redhat.io/oadp/oadp-velero-plugin-for-aws-rhel9@sha256:2a099649d3d7101a0b6dff9f6372bc76903ba6ecb6578dbeef8a8b3853f48026 registry.redhat.io/oadp/oadp-velero-plugin-for-aws-rhel9@sha256:2a099649d3d7101a0b6dff9f6372bc76903ba6ecb6578dbeef8a8b3853f48026 cri-o://08e67b995c82e7b1e6c8865a3fe9012be572d2b4a447b3c60abaf05ecbeb0a29 0xc0008d6368 map[cpu:{{500 -3} {} 500m DecimalSI} memory:{{134217728 0} {} BinarySI}] &ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{134217728 0} {} BinarySI},},Claims:[]ResourceClaim{},} [{plugins /target false } {kube-api-access-7sznb /var/run/secrets/kubernetes.io/serviceaccount true 0xc000c24070}] &ContainerUser{Linux:&LinuxContainerUser{UID:1000740000,GID:0,SupplementalGroups:[0 1000740000],},} []} {kubevirt-velero-plugin {nil nil &ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2026-02-05 16:27:58 +0000 UTC,FinishedAt:2026-02-05 16:27:58 +0000 UTC,ContainerID:cri-o://3032ceec383f5eec0f250eb6afe16990618617d8fd129679d84c83c8d75e5cfd,}} {nil nil nil} true 0 registry.redhat.io/oadp/oadp-kubevirt-velero-plugin-rhel9@sha256:77d6057b1783872ec65d7d6a88d8a1212c38aacc982c7efd46ed2eb77b5e9e70 registry.redhat.io/oadp/oadp-kubevirt-velero-plugin-rhel9@sha256:684020e409da37fd3a41935b51ac22e506fb7a45e787ae8c0cfd6ac0dfcbff09 cri-o://3032ceec383f5eec0f250eb6afe16990618617d8fd129679d84c83c8d75e5cfd 0xc0008d6419 map[cpu:{{500 -3} {} 500m DecimalSI} memory:{{134217728 0} {} BinarySI}] &ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{134217728 0} {} BinarySI},},Claims:[]ResourceClaim{},} [{plugins /target false } {kube-api-access-7sznb /var/run/secrets/kubernetes.io/serviceaccount true 0xc000c240e0}] &ContainerUser{Linux:&LinuxContainerUser{UID:1000740000,GID:0,SupplementalGroups:[0 1000740000],},} []} {hypershift-oadp-plugin {&ContainerStateWaiting{Reason:PodInitializing,Message:,} nil nil} {nil nil nil} false 0 registry.redhat.io/oadp/oadp-hypershift-velero-plugin-rhel9@sha256:f8798364f94bb1bf4db264b0439c5a280b40cafa408c47b4160d9cc9c5d87e53 0xc0008d6478 map[] nil [{plugins /target false } {kube-api-access-7sznb /var/run/secrets/kubernetes.io/serviceaccount true 0xc000c240f0}] nil []}] [{velero {&ContainerStateWaiting{Reason:PodInitializing,Message:,} nil nil} {nil nil nil} false 0 registry.redhat.io/oadp/oadp-velero-rhel9@sha256:dd5897b1579599cfa8d8a03a1c8d3cf68e3927c4ba5dee4e33c2a2d4c9e6ed89 0xc0008d64c6 map[] nil [{plugins /plugins false } {scratch /scratch false } {certs /etc/ssl/certs false } {bound-sa-token /var/run/secrets/openshift/serviceaccount true 0xc000c24100} {kube-api-access-7sznb /var/run/secrets/kubernetes.io/serviceaccount true 0xc000c24110}] nil []}] Burstable [] []} 2026/02/05 16:28:05 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete' 2026/02/05 16:28:05 DPA successfully reconciled STEP: Prepare backup resources, depending on the volumes backup type @ 02/05/26 16:28:05.334 Run the command: oc get ns openshift-storage &> /dev/null && echo true || echo false 2026/02/05 16:28:05 The 'openshift-storage' namespace exists 2026/02/05 16:28:05 Checking default storage class count 2026/02/05 16:28:05 Using the CSI driver: openshift-storage.rbd.csi.ceph.com 2026/02/05 16:28:05 Snapclass 'example-snapclass' doesn't exist, creating 2026/02/05 16:28:05 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 16:28:05 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2026/02/05 16:28:05 Checking for correct number of running NodeAgent pods... STEP: Installing application for case ocp-kubevirt @ 02/05/26 16:28:05.575 2026/02/05 16:28:05 🔄 [Attempt 1/3] Executing operation: Deploy application ocp-kubevirt 2026/02/05 16:28:05 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: WorkerProcess for [localhost/TASK: Extract Kubernetes minor version from cluster] errantly sent data directly to stderr instead of using Display:  /usr/local/lib/python3.12/site-packages/urllib3/connectionpool.py:1013: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com'. Adding certificate verification is strongly advised. Se  [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** changed: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11  30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11  40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** changed: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18  49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}"  ^ column 18  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create resources] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml for localhost [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create namespace] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Deploy VM test-vm] *** changed: [localhost] FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (60 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (59 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (58 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (57 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (56 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (55 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (54 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (53 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (52 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (51 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:44:11  42 --command "echo '{{ text_content }}' > {{ file_path }}" 43 environment: 44 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  FAILED - RETRYING: [localhost]: Run echo command on the VM (60 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Run echo command on the VM] *** changed: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:60:11  58 --command "cat {{ file_path }}" 59 environment: 60 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify file creation and content] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Display confirmation message] *** ok: [localhost] => {  "msg": "Text content written to '/home/fedora/test' on the VM 'test-vm' successfully." } PLAY RECAP ********************************************************************* localhost : ok=27  changed=11  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026/02/05 16:29:33 2026-02-05 16:28:07,395 p=19799 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:28:07,395 p=19799 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:28:07,713 p=19799 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:28:07,713 p=19799 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:28:08,028 p=19799 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:28:08,029 p=19799 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:28:08,363 p=19799 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:28:08,364 p=19799 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:28:08,383 p=19799 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:28:08,383 p=19799 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:28:08,383 p=19799 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:28:08,403 p=19799 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:28:08,403 p=19799 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:28:08,418 p=19799 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:28:08,419 p=19799 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:28:08,920 p=19799 u=1001930000 n=ansible WARNING| [WARNING]: WorkerProcess for [localhost/TASK: Extract Kubernetes minor version from cluster] errantly sent data directly to stderr instead of using Display: /usr/local/lib/python3.12/site-packages/urllib3/connectionpool.py:1013: InsecureRequestWarning: Unverified HTTPS request is being made to host 'api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com'. Adding certificate verification is strongly advised. Se 2026-02-05 16:28:08,922 p=19799 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:28:08,923 p=19799 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:28:08,923 p=19799 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:28:08,923 p=19799 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:28:08,953 p=19799 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:28:08,953 p=19799 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:28:08,976 p=19799 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:28:08,976 p=19799 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:28:08,979 p=19799 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:28:09,600 p=19799 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:28:09,601 p=19799 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:28:13,161 p=19799 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** 2026-02-05 16:28:13,161 p=19799 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:28:14,283 p=19799 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** 2026-02-05 16:28:14,283 p=19799 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:28:14,679 p=19799 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** 2026-02-05 16:28:14,679 p=19799 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11 30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:28:14,680 p=19799 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:28:15,053 p=19799 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** 2026-02-05 16:28:15,054 p=19799 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11 40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:28:15,054 p=19799 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:28:15,082 p=19799 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** 2026-02-05 16:28:15,082 p=19799 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18 49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}" ^ column 18 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:28:15,083 p=19799 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:28:15,125 p=19799 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create resources] *** 2026-02-05 16:28:15,142 p=19799 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml for localhost 2026-02-05 16:28:16,319 p=19799 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create namespace] *** 2026-02-05 16:28:16,319 p=19799 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:28:16,320 p=19799 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:28:16,320 p=19799 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:28:16,320 p=19799 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:28:16,320 p=19799 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:28:17,365 p=19799 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Deploy VM test-vm] *** 2026-02-05 16:28:17,365 p=19799 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:28:18,468 p=19799 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (60 retries left). 2026-02-05 16:28:24,412 p=19799 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (59 retries left). 2026-02-05 16:28:30,375 p=19799 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (58 retries left). 2026-02-05 16:28:36,285 p=19799 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (57 retries left). 2026-02-05 16:28:42,188 p=19799 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (56 retries left). 2026-02-05 16:28:48,137 p=19799 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (55 retries left). 2026-02-05 16:28:54,052 p=19799 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (54 retries left). 2026-02-05 16:28:59,969 p=19799 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (53 retries left). 2026-02-05 16:29:05,892 p=19799 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (52 retries left). 2026-02-05 16:29:11,850 p=19799 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (51 retries left). 2026-02-05 16:29:17,768 p=19799 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** 2026-02-05 16:29:17,768 p=19799 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:29:21,292 p=19799 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Run echo command on the VM (60 retries left). 2026-02-05 16:29:33,266 p=19799 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Run echo command on the VM] *** 2026-02-05 16:29:33,267 p=19799 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:44:11 42 --command "echo '{{ text_content }}' > {{ file_path }}" 43 environment: 44 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:29:33,267 p=19799 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:29:33,775 p=19799 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify file creation and content] *** 2026-02-05 16:29:33,775 p=19799 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:60:11 58 --command "cat {{ file_path }}" 59 environment: 60 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:29:33,775 p=19799 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:29:33,793 p=19799 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Display confirmation message] *** 2026-02-05 16:29:33,794 p=19799 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Text content written to '/home/fedora/test' on the VM 'test-vm' successfully." } 2026-02-05 16:29:33,849 p=19799 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:29:33,849 p=19799 u=1001930000 n=ansible INFO| localhost : ok=27 changed=11 unreachable=0 failed=0 skipped=7 rescued=0 ignored=0 STEP: Verify Application deployment @ 02/05/26 16:29:33.912 2026/02/05 16:29:33 Using admin kubeconfig for with_validate operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11  30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11  40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18  49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}"  ^ column 18  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Validate migration] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml for localhost [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to have AgentConnected status True indicating the guest agent is running] *** [ERROR]: Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result.  Task failed. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:33:3  31 when: vm_running | bool 32 33 - name: Wait for VM to have AgentConnected status True indicating the guest agent is running  ^ column 3  <<< caused by >>>  Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10  41 verify_ssl: no 42 register: vm 43 until: vm.resources[0].status.conditions | selectattr('type', 'equalto', 'AgentConnected') | selectattr('status'...  ^ column 10  Broken conditionals can be temporarily allowed with the `ALLOW_BROKEN_CONDITIONALS` configuration option.  fatal: [localhost]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result."} PLAY RECAP ********************************************************************* localhost : ok=22  changed=4  unreachable=0 failed=1  skipped=6  rescued=0 ignored=0 2026/02/05 16:29:41 2026-02-05 16:29:35,603 p=21272 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:29:35,603 p=21272 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:29:35,925 p=21272 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:29:35,925 p=21272 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:29:36,247 p=21272 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:29:36,247 p=21272 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:29:36,565 p=21272 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:29:36,565 p=21272 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:29:36,584 p=21272 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:29:36,584 p=21272 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:29:36,585 p=21272 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:29:36,605 p=21272 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:29:36,605 p=21272 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:29:36,621 p=21272 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:29:36,621 p=21272 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:29:37,094 p=21272 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:29:37,094 p=21272 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:29:37,095 p=21272 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:29:37,095 p=21272 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:29:37,129 p=21272 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:29:37,130 p=21272 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:29:37,152 p=21272 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:29:37,152 p=21272 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:29:37,156 p=21272 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:29:37,789 p=21272 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:29:37,789 p=21272 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:29:38,041 p=21272 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** 2026-02-05 16:29:38,042 p=21272 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:29:38,293 p=21272 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** 2026-02-05 16:29:38,293 p=21272 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:29:38,683 p=21272 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** 2026-02-05 16:29:38,684 p=21272 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11 30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:29:38,684 p=21272 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:29:39,052 p=21272 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** 2026-02-05 16:29:39,053 p=21272 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11 40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:29:39,053 p=21272 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:29:39,080 p=21272 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** 2026-02-05 16:29:39,080 p=21272 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18 49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}" ^ column 18 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:29:39,080 p=21272 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:29:39,141 p=21272 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Validate migration] *** 2026-02-05 16:29:39,155 p=21272 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml for localhost 2026-02-05 16:29:40,286 p=21272 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** 2026-02-05 16:29:40,286 p=21272 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:29:40,287 p=21272 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:29:40,287 p=21272 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:29:40,287 p=21272 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:29:40,287 p=21272 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:29:41,274 p=21272 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to have AgentConnected status True indicating the guest agent is running] *** 2026-02-05 16:29:41,275 p=21272 u=1001930000 n=ansible ERROR| [ERROR]: Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result. Task failed. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:33:3 31 when: vm_running | bool 32 33 - name: Wait for VM to have AgentConnected status True indicating the guest agent is running ^ column 3 <<< caused by >>> Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10 41 verify_ssl: no 42 register: vm 43 until: vm.resources[0].status.conditions | selectattr('type', 'equalto', 'AgentConnected') | selectattr('status'... ^ column 10 Broken conditionals can be temporarily allowed with the `ALLOW_BROKEN_CONDITIONALS` configuration option. 2026-02-05 16:29:41,275 p=21272 u=1001930000 n=ansible INFO| fatal: [localhost]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result."} 2026-02-05 16:29:41,276 p=21272 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:29:41,276 p=21272 u=1001930000 n=ansible INFO| localhost : ok=22 changed=4 unreachable=0 failed=1 skipped=6 rescued=0 ignored=0 Run the command: oc get event -n test-oadp-401 2026/02/05 16:29:41 LAST SEEN TYPE REASON OBJECT MESSAGE 84s Warning FailedScheduling pod/importer-prime-6bc370d0-cead-4cf4-913b-e03e8ad9157b 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 83s Warning FailedScheduling pod/importer-prime-6bc370d0-cead-4cf4-913b-e03e8ad9157b 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 72s Normal Scheduled pod/importer-prime-6bc370d0-cead-4cf4-913b-e03e8ad9157b Successfully assigned test-oadp-401/importer-prime-6bc370d0-cead-4cf4-913b-e03e8ad9157b to ip-10-0-60-83.us-east-2.compute.internal 72s Normal SuccessfulAttachVolume pod/importer-prime-6bc370d0-cead-4cf4-913b-e03e8ad9157b AttachVolume.Attach succeeded for volume "pvc-85002fb5-5439-4ed1-85e4-ec90cb121595" 71s Normal AddedInterface pod/importer-prime-6bc370d0-cead-4cf4-913b-e03e8ad9157b Add eth0 [10.129.2.80/23] from ovn-kubernetes 71s Normal Pulled pod/importer-prime-6bc370d0-cead-4cf4-913b-e03e8ad9157b Container image "registry.redhat.io/container-native-virtualization/virt-cdi-importer-rhel9@sha256:84d3534ff8027475d41f6dee3c827640905b98dc5251c6a31abad5c7d4cdb2dc" already present on machine 71s Normal Created pod/importer-prime-6bc370d0-cead-4cf4-913b-e03e8ad9157b Created container: init 71s Normal Started pod/importer-prime-6bc370d0-cead-4cf4-913b-e03e8ad9157b Started container init 71s Normal Pulled pod/importer-prime-6bc370d0-cead-4cf4-913b-e03e8ad9157b Container image "registry.redhat.io/container-native-virtualization/virt-cdi-importer-rhel9@sha256:84d3534ff8027475d41f6dee3c827640905b98dc5251c6a31abad5c7d4cdb2dc" already present on machine 71s Normal Created pod/importer-prime-6bc370d0-cead-4cf4-913b-e03e8ad9157b Created container: importer 71s Normal Started pod/importer-prime-6bc370d0-cead-4cf4-913b-e03e8ad9157b Started container importer 71s Normal Pulling pod/importer-prime-6bc370d0-cead-4cf4-913b-e03e8ad9157b Pulling image "quay.io/kubevirt/fedora-with-test-tooling-container-disk" 58s Normal Pulled pod/importer-prime-6bc370d0-cead-4cf4-913b-e03e8ad9157b Successfully pulled image "quay.io/kubevirt/fedora-with-test-tooling-container-disk" in 12.724s (12.724s including waiting). Image size: 592396892 bytes. 58s Normal Created pod/importer-prime-6bc370d0-cead-4cf4-913b-e03e8ad9157b Created container: server 58s Normal Started pod/importer-prime-6bc370d0-cead-4cf4-913b-e03e8ad9157b Started container server 84s Warning ProvisioningFailed persistentvolumeclaim/prime-6bc370d0-cead-4cf4-913b-e03e8ad9157b Error saving claim: Operation cannot be fulfilled on persistentvolumeclaims "prime-6bc370d0-cead-4cf4-913b-e03e8ad9157b": the object has been modified; please apply your changes to the latest version and try again 78s Normal Provisioning persistentvolumeclaim/prime-6bc370d0-cead-4cf4-913b-e03e8ad9157b External provisioner is provisioning volume for claim "test-oadp-401/prime-6bc370d0-cead-4cf4-913b-e03e8ad9157b" 78s Normal ExternalProvisioning persistentvolumeclaim/prime-6bc370d0-cead-4cf4-913b-e03e8ad9157b Waiting for a volume to be created either by the external provisioner 'openshift-storage.cephfs.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 73s Normal ProvisioningSucceeded persistentvolumeclaim/prime-6bc370d0-cead-4cf4-913b-e03e8ad9157b Successfully provisioned volume pvc-85002fb5-5439-4ed1-85e4-ec90cb121595 41s Normal ImportSucceeded persistentvolumeclaim/prime-6bc370d0-cead-4cf4-913b-e03e8ad9157b Import Successful 33s Warning ClaimMisbound persistentvolumeclaim/prime-6bc370d0-cead-4cf4-913b-e03e8ad9157b Two claims are bound to the same volume, this one is bound incorrectly 39s Warning UnrecognizedDataSourceKind persistentvolumeclaim/test-vm-dv The datasource for this PVC does not match any registered VolumePopulator 84s Normal NotFound datavolume/test-vm-dv No PVC found 84s Normal CreatedPVCPrimeSuccessfully persistentvolumeclaim/test-vm-dv PVC Prime created successfully 39s Normal Provisioning persistentvolumeclaim/test-vm-dv External provisioner is provisioning volume for claim "test-oadp-401/test-vm-dv" 39s Normal Provisioning persistentvolumeclaim/test-vm-dv Assuming an external populator will provision the volume 39s Normal ExternalProvisioning persistentvolumeclaim/test-vm-dv Waiting for a volume to be created either by the external provisioner 'openshift-storage.cephfs.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 84s Normal Pending datavolume/test-vm-dv PVC test-vm-dv Pending 73s Normal ImportScheduled datavolume/test-vm-dv Import into test-vm-dv scheduled 57s Normal ImportInProgress datavolume/test-vm-dv Import into test-vm-dv in progress 42s Warning Completed datavolume/test-vm-dv Import Complete 33s Normal importSucceeded persistentvolumeclaim/test-vm-dv Successfully imported into test-vm-dv 39s Normal ImportSucceeded datavolume/test-vm-dv Successfully imported into PVC test-vm-dv 39s Normal Bound datavolume/test-vm-dv PVC test-vm-dv Bound 84s Normal SuccessfulDataVolumeCreate virtualmachine/test-vm Created DataVolume test-vm-dv 39s Normal SuccessfulCreate virtualmachine/test-vm Started the virtual machine by creating the new virtual machine instance test-vm 39s Normal SuccessfulCreate virtualmachineinstance/test-vm Created virtual machine pod virt-launcher-test-vm-p4855 27s Normal Created virtualmachineinstance/test-vm VirtualMachineInstance defined. 5s Warning Migrated virtualmachineinstance/test-vm EvictionStrategy is set but vmi is not migratable; cannot migrate VMI: PVC test-vm-dv is not shared, live migration requires that all PVCs must be shared (using ReadWriteMany access mode) 27s Normal Started virtualmachineinstance/test-vm VirtualMachineInstance started. 38s Normal Scheduled pod/virt-launcher-test-vm-p4855 Successfully assigned test-oadp-401/virt-launcher-test-vm-p4855 to ip-10-0-60-83.us-east-2.compute.internal 30s Normal AddedInterface pod/virt-launcher-test-vm-p4855 Add eth0 [10.129.2.82/23] from ovn-kubernetes 30s Normal Pulled pod/virt-launcher-test-vm-p4855 Container image "registry.redhat.io/container-native-virtualization/virt-launcher-rhel9@sha256:3138ad3a4471ca69be37fbe50a96be4b89e120de0e2808067ca99ff576f16256" already present on machine 30s Normal Created pod/virt-launcher-test-vm-p4855 Created container: guest-console-log 30s Normal Started pod/virt-launcher-test-vm-p4855 Started container guest-console-log 29s Normal Pulled pod/virt-launcher-test-vm-p4855 Container image "registry.redhat.io/container-native-virtualization/virt-launcher-rhel9@sha256:3138ad3a4471ca69be37fbe50a96be4b89e120de0e2808067ca99ff576f16256" already present on machine 29s Normal Created pod/virt-launcher-test-vm-p4855 Created container: compute 29s Normal Started pod/virt-launcher-test-vm-p4855 Started container compute [FAILED] in [It] - /alabama/cspi/test_common/backup_restore_app_case.go:52 @ 02/05/26 16:29:41.448 < Exit [It] [tc-id:OADP-401] [kubevirt] [Tier1] Started VM should over ceph filesytem mode @ 02/05/26 16:29:41.448 (1m56.223s) > Enter [JustAfterEach] TOP-LEVEL @ 02/05/26 16:29:41.448 2026/02/05 16:29:41 Using Must-gather image: registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 STEP: Get the failed spec name @ 02/05/26 16:29:41.448 2026/02/05 16:29:41 The failed spec name is: Native CSI Data Mover: Backup/Restore Openshift Virtualization Workloads [tc-id:OADP-401] [kubevirt] [Tier1] Started VM should over ceph filesytem mode STEP: Create a folder for all must-gather files if it doesn't exists already @ 02/05/26 16:29:41.448 2026/02/05 16:29:41 The folder logs does not exists, creating new folder with the name: logs STEP: Create a folder for the failed spec if it doesn't exists already @ 02/05/26 16:29:41.448 2026/02/05 16:29:41 The folder logs/It_Native_CSI_Data_Mover_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-401_kubevirt_Tier1_Started_VM_should_over_ceph_filesytem_mode does not exists, creating new folder with the name: logs/It_Native_CSI_Data_Mover_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-401_kubevirt_Tier1_Started_VM_should_over_ceph_filesytem_mode STEP: Run must-gather because the spec failed @ 02/05/26 16:29:41.448 2026/02/05 16:29:41 Log the present working directory path:- /alabama/cspi/e2e/kubevirt-plugin 2026/02/05 16:29:41 [adm must-gather --dest-dir /alabama/cspi/e2e/kubevirt-plugin/logs/It_Native_CSI_Data_Mover_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-401_kubevirt_Tier1_Started_VM_should_over_ceph_filesytem_mode --image registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3] 2026/02/05 16:30:02 Log all the files present in /alabama/cspi/e2e/kubevirt-plugin/logs directory 2026/02/05 16:30:02 It_Native_CSI_Data_Mover_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-401_kubevirt_Tier1_Started_VM_should_over_ceph_filesytem_mode STEP: Find must-gather folder and rename it to a shorter more readable name @ 02/05/26 16:30:02.077 < Exit [JustAfterEach] TOP-LEVEL @ 02/05/26 16:30:02.077 (20.629s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:30:02.077 2026/02/05 16:30:02 Cleaning app 2026/02/05 16:30:02 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11  30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11  40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18  49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}"  ^ column 18  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Cleanup resources] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/cleanup.yml for localhost [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-401] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=22  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026/02/05 16:30:33 2026-02-05 16:30:03,836 p=21625 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:30:03,836 p=21625 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:30:04,169 p=21625 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:30:04,169 p=21625 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:30:04,491 p=21625 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:30:04,491 p=21625 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:30:04,832 p=21625 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:30:04,833 p=21625 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:30:04,851 p=21625 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:30:04,851 p=21625 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:30:04,852 p=21625 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:30:04,872 p=21625 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:30:04,872 p=21625 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:30:04,888 p=21625 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:30:04,888 p=21625 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:30:05,340 p=21625 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:30:05,341 p=21625 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:30:05,341 p=21625 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:30:05,341 p=21625 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:30:05,371 p=21625 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:30:05,371 p=21625 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:30:05,394 p=21625 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:30:05,394 p=21625 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:30:05,397 p=21625 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:30:06,011 p=21625 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:30:06,011 p=21625 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:30:06,259 p=21625 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** 2026-02-05 16:30:06,259 p=21625 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:30:06,530 p=21625 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** 2026-02-05 16:30:06,530 p=21625 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:30:06,916 p=21625 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** 2026-02-05 16:30:06,917 p=21625 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11 30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:30:06,917 p=21625 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:30:07,287 p=21625 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** 2026-02-05 16:30:07,288 p=21625 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11 40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:30:07,288 p=21625 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:30:07,313 p=21625 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** 2026-02-05 16:30:07,313 p=21625 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18 49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}" ^ column 18 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:30:07,313 p=21625 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:30:07,333 p=21625 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Cleanup resources] *** 2026-02-05 16:30:07,343 p=21625 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/cleanup.yml for localhost 2026-02-05 16:30:33,511 p=21625 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-401] *** 2026-02-05 16:30:33,512 p=21625 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:30:33,512 p=21625 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:30:33,512 p=21625 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:30:33,512 p=21625 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:30:33,512 p=21625 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:30:33,576 p=21625 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:30:33,577 p=21625 u=1001930000 n=ansible INFO| localhost : ok=22 changed=5 unreachable=0 failed=0 skipped=6 rescued=0 ignored=0 < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:30:33.632 (31.555s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:30:33.632 2026/02/05 16:30:33 Cleaning setup resources for the backup 2026/02/05 16:30:33 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 16:30:33 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2026/02/05 16:30:33 Deleting VolumeSnapshotClass 'example-snapclass' < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:30:33.66 (29ms) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:30:33.66 2026/02/05 16:30:33 Deleting DPA CR < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:30:33.671 (10ms) Attempt #1 Failed. Retrying ↺ @ 02/05/26 16:30:33.671 > Enter [JustBeforeEach] TOP-LEVEL @ 02/05/26 16:30:33.671 < Exit [JustBeforeEach] TOP-LEVEL @ 02/05/26 16:30:33.671 (0s) > Enter [It] [tc-id:OADP-401] [kubevirt] [Tier1] Started VM should over ceph filesytem mode @ 02/05/26 16:30:33.671 2026/02/05 16:30:33 Delete all downloadrequest No download requests are found STEP: Create DPA CR @ 02/05/26 16:30:33.675 2026/02/05 16:30:33 native-datamover 2026/02/05 16:30:33 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "4591c79a-b8f0-4ffb-bbc8-9b41acbe9427", "resourceVersion": "72865", "generation": 1, "creationTimestamp": "2026-02-05T16:30:33Z", "managedFields": [ { "manager": "kubevirt-plugin.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T16:30:33Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:nodeAgent": { ".": {}, "f:enable": {}, "f:podConfig": { ".": {}, "f:resourceAllocations": {} }, "f:uploaderType": {} }, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "kubevirt" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false }, "nodeAgent": { "enable": true, "podConfig": { "resourceAllocations": {} }, "uploaderType": "kopia" } }, "features": null, "logFormat": "text" }, "status": {} } Delete all the backups that remained in the phase InProgress Deleting backup CRs in progress Deletion of backup CRs in progress completed Delete all the restores that remained in the phase InProgress Deleting restore CRs in progress Deletion of restore CRs in progress completed STEP: Verify DPA CR setup @ 02/05/26 16:30:33.734 2026/02/05 16:30:33 Waiting for velero pod to be running 2026/02/05 16:30:33 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete' 2026/02/05 16:30:33 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "4591c79a-b8f0-4ffb-bbc8-9b41acbe9427", "resourceVersion": "72865", "generation": 1, "creationTimestamp": "2026-02-05T16:30:33Z", "managedFields": [ { "manager": "kubevirt-plugin.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T16:30:33Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:nodeAgent": { ".": {}, "f:enable": {}, "f:podConfig": { ".": {}, "f:resourceAllocations": {} }, "f:uploaderType": {} }, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "kubevirt" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false }, "nodeAgent": { "enable": true, "podConfig": { "resourceAllocations": {} }, "uploaderType": "kopia" } }, "features": null, "logFormat": "text" }, "status": {} } 2026/02/05 16:30:38 DPA successfully reconciled STEP: Prepare backup resources, depending on the volumes backup type @ 02/05/26 16:30:38.772 2026/02/05 16:30:38 Snapclass 'example-snapclass' doesn't exist, creating 2026/02/05 16:30:38 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 16:30:38 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2026/02/05 16:30:38 Checking for correct number of running NodeAgent pods... STEP: Installing application for case ocp-kubevirt @ 02/05/26 16:30:38.904 2026/02/05 16:30:38 🔄 [Attempt 1/3] Executing operation: Deploy application ocp-kubevirt 2026/02/05 16:30:38 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11  30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11  40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18  49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}"  ^ column 18  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create resources] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml for localhost [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create namespace] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Deploy VM test-vm] *** changed: [localhost] FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (60 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (59 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (58 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (57 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (56 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (55 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (54 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (53 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (52 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:44:11  42 --command "echo '{{ text_content }}' > {{ file_path }}" 43 environment: 44 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  FAILED - RETRYING: [localhost]: Run echo command on the VM (60 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Run echo command on the VM] *** changed: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:60:11  58 --command "cat {{ file_path }}" 59 environment: 60 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify file creation and content] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Display confirmation message] *** ok: [localhost] => {  "msg": "Text content written to '/home/fedora/test' on the VM 'test-vm' successfully." } PLAY RECAP ********************************************************************* localhost : ok=27  changed=8  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026/02/05 16:31:57 2026-02-05 16:30:40,625 p=21899 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:30:40,625 p=21899 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:30:40,953 p=21899 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:30:40,953 p=21899 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:30:41,277 p=21899 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:30:41,278 p=21899 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:30:41,594 p=21899 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:30:41,595 p=21899 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:30:41,614 p=21899 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:30:41,614 p=21899 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:30:41,614 p=21899 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:30:41,634 p=21899 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:30:41,635 p=21899 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:30:41,650 p=21899 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:30:41,651 p=21899 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:30:42,094 p=21899 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:30:42,094 p=21899 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:30:42,095 p=21899 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:30:42,095 p=21899 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:30:42,124 p=21899 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:30:42,125 p=21899 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:30:42,148 p=21899 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:30:42,149 p=21899 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:30:42,152 p=21899 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:30:42,770 p=21899 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:30:42,770 p=21899 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:30:43,035 p=21899 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** 2026-02-05 16:30:43,036 p=21899 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:30:43,286 p=21899 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** 2026-02-05 16:30:43,286 p=21899 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:30:43,678 p=21899 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** 2026-02-05 16:30:43,679 p=21899 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11 30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:30:43,679 p=21899 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:30:44,055 p=21899 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** 2026-02-05 16:30:44,056 p=21899 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11 40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:30:44,056 p=21899 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:30:44,081 p=21899 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** 2026-02-05 16:30:44,081 p=21899 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18 49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}" ^ column 18 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:30:44,081 p=21899 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:30:44,120 p=21899 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create resources] *** 2026-02-05 16:30:44,137 p=21899 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml for localhost 2026-02-05 16:30:45,291 p=21899 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create namespace] *** 2026-02-05 16:30:45,291 p=21899 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:30:45,292 p=21899 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:30:45,292 p=21899 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:30:45,292 p=21899 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:30:45,292 p=21899 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:30:46,334 p=21899 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Deploy VM test-vm] *** 2026-02-05 16:30:46,335 p=21899 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:30:47,451 p=21899 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (60 retries left). 2026-02-05 16:30:53,362 p=21899 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (59 retries left). 2026-02-05 16:30:59,339 p=21899 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (58 retries left). 2026-02-05 16:31:05,292 p=21899 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (57 retries left). 2026-02-05 16:31:11,235 p=21899 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (56 retries left). 2026-02-05 16:31:17,162 p=21899 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (55 retries left). 2026-02-05 16:31:23,138 p=21899 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (54 retries left). 2026-02-05 16:31:29,093 p=21899 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (53 retries left). 2026-02-05 16:31:35,008 p=21899 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (52 retries left). 2026-02-05 16:31:40,970 p=21899 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** 2026-02-05 16:31:40,970 p=21899 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:31:44,421 p=21899 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Run echo command on the VM (60 retries left). 2026-02-05 16:31:56,572 p=21899 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Run echo command on the VM] *** 2026-02-05 16:31:56,573 p=21899 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:44:11 42 --command "echo '{{ text_content }}' > {{ file_path }}" 43 environment: 44 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:31:56,573 p=21899 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:31:57,069 p=21899 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify file creation and content] *** 2026-02-05 16:31:57,069 p=21899 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:60:11 58 --command "cat {{ file_path }}" 59 environment: 60 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:31:57,069 p=21899 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:31:57,086 p=21899 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Display confirmation message] *** 2026-02-05 16:31:57,086 p=21899 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Text content written to '/home/fedora/test' on the VM 'test-vm' successfully." } 2026-02-05 16:31:57,132 p=21899 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:31:57,133 p=21899 u=1001930000 n=ansible INFO| localhost : ok=27 changed=8 unreachable=0 failed=0 skipped=7 rescued=0 ignored=0 STEP: Verify Application deployment @ 02/05/26 16:31:57.195 2026/02/05 16:31:57 Using admin kubeconfig for with_validate operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11  30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11  40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18  49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}"  ^ column 18  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Validate migration] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml for localhost [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to have AgentConnected status True indicating the guest agent is running] *** [ERROR]: Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result.  Task failed. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:33:3  31 when: vm_running | bool 32 33 - name: Wait for VM to have AgentConnected status True indicating the guest agent is running  ^ column 3  <<< caused by >>>  Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10  41 verify_ssl: no 42 register: vm 43 until: vm.resources[0].status.conditions | selectattr('type', 'equalto', 'AgentConnected') | selectattr('status'...  ^ column 10  Broken conditionals can be temporarily allowed with the `ALLOW_BROKEN_CONDITIONALS` configuration option.  fatal: [localhost]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result."} PLAY RECAP ********************************************************************* localhost : ok=22  changed=4  unreachable=0 failed=1  skipped=6  rescued=0 ignored=0 2026/02/05 16:32:04 2026-02-05 16:31:58,928 p=22437 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:31:58,929 p=22437 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:31:59,251 p=22437 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:31:59,251 p=22437 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:31:59,568 p=22437 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:31:59,569 p=22437 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:31:59,893 p=22437 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:31:59,893 p=22437 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:31:59,912 p=22437 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:31:59,913 p=22437 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:31:59,913 p=22437 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:31:59,934 p=22437 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:31:59,934 p=22437 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:31:59,949 p=22437 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:31:59,950 p=22437 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:32:00,397 p=22437 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:32:00,397 p=22437 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:32:00,397 p=22437 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:32:00,397 p=22437 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:32:00,426 p=22437 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:32:00,426 p=22437 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:32:00,450 p=22437 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:32:00,451 p=22437 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:32:00,453 p=22437 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:32:01,059 p=22437 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:32:01,059 p=22437 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:32:01,314 p=22437 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** 2026-02-05 16:32:01,315 p=22437 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:32:01,572 p=22437 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** 2026-02-05 16:32:01,572 p=22437 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:32:01,953 p=22437 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** 2026-02-05 16:32:01,954 p=22437 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11 30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:32:01,954 p=22437 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:32:02,323 p=22437 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** 2026-02-05 16:32:02,324 p=22437 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11 40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:32:02,324 p=22437 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:32:02,349 p=22437 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** 2026-02-05 16:32:02,350 p=22437 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18 49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}" ^ column 18 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:32:02,350 p=22437 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:32:02,403 p=22437 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Validate migration] *** 2026-02-05 16:32:02,415 p=22437 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml for localhost 2026-02-05 16:32:03,576 p=22437 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** 2026-02-05 16:32:03,576 p=22437 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:32:03,576 p=22437 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:32:03,576 p=22437 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:32:03,577 p=22437 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:32:03,577 p=22437 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:32:04,524 p=22437 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to have AgentConnected status True indicating the guest agent is running] *** 2026-02-05 16:32:04,525 p=22437 u=1001930000 n=ansible ERROR| [ERROR]: Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result. Task failed. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:33:3 31 when: vm_running | bool 32 33 - name: Wait for VM to have AgentConnected status True indicating the guest agent is running ^ column 3 <<< caused by >>> Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10 41 verify_ssl: no 42 register: vm 43 until: vm.resources[0].status.conditions | selectattr('type', 'equalto', 'AgentConnected') | selectattr('status'... ^ column 10 Broken conditionals can be temporarily allowed with the `ALLOW_BROKEN_CONDITIONALS` configuration option. 2026-02-05 16:32:04,526 p=22437 u=1001930000 n=ansible INFO| fatal: [localhost]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result."} 2026-02-05 16:32:04,526 p=22437 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:32:04,527 p=22437 u=1001930000 n=ansible INFO| localhost : ok=22 changed=4 unreachable=0 failed=1 skipped=6 rescued=0 ignored=0 Run the command: oc get event -n test-oadp-401 2026/02/05 16:32:04 LAST SEEN TYPE REASON OBJECT MESSAGE 78s Warning FailedScheduling pod/importer-prime-0b11572a-c63b-4392-96ff-8cce0ad9bb33 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 71s Warning FailedScheduling pod/importer-prime-0b11572a-c63b-4392-96ff-8cce0ad9bb33 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 70s Normal Scheduled pod/importer-prime-0b11572a-c63b-4392-96ff-8cce0ad9bb33 Successfully assigned test-oadp-401/importer-prime-0b11572a-c63b-4392-96ff-8cce0ad9bb33 to ip-10-0-60-83.us-east-2.compute.internal 70s Normal SuccessfulAttachVolume pod/importer-prime-0b11572a-c63b-4392-96ff-8cce0ad9bb33 AttachVolume.Attach succeeded for volume "pvc-98f95fd9-04e7-48bf-9db9-e9346abda8ec" 61s Normal AddedInterface pod/importer-prime-0b11572a-c63b-4392-96ff-8cce0ad9bb33 Add eth0 [10.129.2.86/23] from ovn-kubernetes 61s Normal Pulled pod/importer-prime-0b11572a-c63b-4392-96ff-8cce0ad9bb33 Container image "registry.redhat.io/container-native-virtualization/virt-cdi-importer-rhel9@sha256:84d3534ff8027475d41f6dee3c827640905b98dc5251c6a31abad5c7d4cdb2dc" already present on machine 61s Normal Created pod/importer-prime-0b11572a-c63b-4392-96ff-8cce0ad9bb33 Created container: init 61s Normal Started pod/importer-prime-0b11572a-c63b-4392-96ff-8cce0ad9bb33 Started container init 61s Normal Pulled pod/importer-prime-0b11572a-c63b-4392-96ff-8cce0ad9bb33 Container image "registry.redhat.io/container-native-virtualization/virt-cdi-importer-rhel9@sha256:84d3534ff8027475d41f6dee3c827640905b98dc5251c6a31abad5c7d4cdb2dc" already present on machine 61s Normal Created pod/importer-prime-0b11572a-c63b-4392-96ff-8cce0ad9bb33 Created container: importer 61s Normal Started pod/importer-prime-0b11572a-c63b-4392-96ff-8cce0ad9bb33 Started container importer 61s Normal Pulled pod/importer-prime-0b11572a-c63b-4392-96ff-8cce0ad9bb33 Container image "quay.io/kubevirt/fedora-with-test-tooling-container-disk" already present on machine 61s Normal Created pod/importer-prime-0b11572a-c63b-4392-96ff-8cce0ad9bb33 Created container: server 61s Normal Started pod/importer-prime-0b11572a-c63b-4392-96ff-8cce0ad9bb33 Started container server 78s Warning ProvisioningFailed persistentvolumeclaim/prime-0b11572a-c63b-4392-96ff-8cce0ad9bb33 Error saving claim: Operation cannot be fulfilled on persistentvolumeclaims "prime-0b11572a-c63b-4392-96ff-8cce0ad9bb33": the object has been modified; please apply your changes to the latest version and try again 71s Normal Provisioning persistentvolumeclaim/prime-0b11572a-c63b-4392-96ff-8cce0ad9bb33 External provisioner is provisioning volume for claim "test-oadp-401/prime-0b11572a-c63b-4392-96ff-8cce0ad9bb33" 71s Normal ExternalProvisioning persistentvolumeclaim/prime-0b11572a-c63b-4392-96ff-8cce0ad9bb33 Waiting for a volume to be created either by the external provisioner 'openshift-storage.cephfs.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 71s Normal ProvisioningSucceeded persistentvolumeclaim/prime-0b11572a-c63b-4392-96ff-8cce0ad9bb33 Successfully provisioned volume pvc-98f95fd9-04e7-48bf-9db9-e9346abda8ec 44s Normal ImportSucceeded persistentvolumeclaim/prime-0b11572a-c63b-4392-96ff-8cce0ad9bb33 Import Successful 41s Warning ClaimMisbound persistentvolumeclaim/prime-0b11572a-c63b-4392-96ff-8cce0ad9bb33 Two claims are bound to the same volume, this one is bound incorrectly 42s Warning UnrecognizedDataSourceKind persistentvolumeclaim/test-vm-dv The datasource for this PVC does not match any registered VolumePopulator 78s Normal CreatedPVCPrimeSuccessfully persistentvolumeclaim/test-vm-dv PVC Prime created successfully 78s Normal NotFound datavolume/test-vm-dv No PVC found 78s Normal Pending datavolume/test-vm-dv PVC test-vm-dv Pending 78s Warning ProvisioningFailed persistentvolumeclaim/test-vm-dv Error saving claim: Operation cannot be fulfilled on persistentvolumeclaims "test-vm-dv": the object has been modified; please apply your changes to the latest version and try again 42s Normal Provisioning persistentvolumeclaim/test-vm-dv External provisioner is provisioning volume for claim "test-oadp-401/test-vm-dv" 42s Normal Provisioning persistentvolumeclaim/test-vm-dv Assuming an external populator will provision the volume 42s Normal ExternalProvisioning persistentvolumeclaim/test-vm-dv Waiting for a volume to be created either by the external provisioner 'openshift-storage.cephfs.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 71s Normal ImportScheduled datavolume/test-vm-dv Import into test-vm-dv scheduled 60s Normal ImportInProgress datavolume/test-vm-dv Import into test-vm-dv in progress 46s Warning Completed datavolume/test-vm-dv Import Complete 41s Normal importSucceeded persistentvolumeclaim/test-vm-dv Successfully imported into test-vm-dv 42s Normal ImportSucceeded datavolume/test-vm-dv Successfully imported into PVC test-vm-dv 42s Normal Bound datavolume/test-vm-dv PVC test-vm-dv Bound 78s Normal SuccessfulDataVolumeCreate virtualmachine/test-vm Created DataVolume test-vm-dv 42s Normal SuccessfulCreate virtualmachine/test-vm Started the virtual machine by creating the new virtual machine instance test-vm 42s Normal SuccessfulCreate virtualmachineinstance/test-vm Created virtual machine pod virt-launcher-test-vm-q9nxf 28s Normal Created virtualmachineinstance/test-vm VirtualMachineInstance defined. 5s Warning Migrated virtualmachineinstance/test-vm EvictionStrategy is set but vmi is not migratable; cannot migrate VMI: PVC test-vm-dv is not shared, live migration requires that all PVCs must be shared (using ReadWriteMany access mode) 28s Normal Started virtualmachineinstance/test-vm VirtualMachineInstance started. 42s Normal Scheduled pod/virt-launcher-test-vm-q9nxf Successfully assigned test-oadp-401/virt-launcher-test-vm-q9nxf to ip-10-0-60-83.us-east-2.compute.internal 41s Normal SuccessfulAttachVolume pod/virt-launcher-test-vm-q9nxf AttachVolume.Attach succeeded for volume "pvc-98f95fd9-04e7-48bf-9db9-e9346abda8ec" 31s Normal AddedInterface pod/virt-launcher-test-vm-q9nxf Add eth0 [10.129.2.88/23] from ovn-kubernetes 31s Normal Pulled pod/virt-launcher-test-vm-q9nxf Container image "registry.redhat.io/container-native-virtualization/virt-launcher-rhel9@sha256:3138ad3a4471ca69be37fbe50a96be4b89e120de0e2808067ca99ff576f16256" already present on machine 30s Normal Created pod/virt-launcher-test-vm-q9nxf Created container: guest-console-log 30s Normal Started pod/virt-launcher-test-vm-q9nxf Started container guest-console-log 30s Normal Pulled pod/virt-launcher-test-vm-q9nxf Container image "registry.redhat.io/container-native-virtualization/virt-launcher-rhel9@sha256:3138ad3a4471ca69be37fbe50a96be4b89e120de0e2808067ca99ff576f16256" already present on machine 30s Normal Created pod/virt-launcher-test-vm-q9nxf Created container: compute 30s Normal Started pod/virt-launcher-test-vm-q9nxf Started container compute [FAILED] in [It] - /alabama/cspi/test_common/backup_restore_app_case.go:52 @ 02/05/26 16:32:04.701 < Exit [It] [tc-id:OADP-401] [kubevirt] [Tier1] Started VM should over ceph filesytem mode @ 02/05/26 16:32:04.701 (1m31.03s) > Enter [JustAfterEach] TOP-LEVEL @ 02/05/26 16:32:04.701 2026/02/05 16:32:04 Using Must-gather image: registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 STEP: Get the failed spec name @ 02/05/26 16:32:04.701 2026/02/05 16:32:04 The failed spec name is: Native CSI Data Mover: Backup/Restore Openshift Virtualization Workloads [tc-id:OADP-401] [kubevirt] [Tier1] Started VM should over ceph filesytem mode STEP: Create a folder for all must-gather files if it doesn't exists already @ 02/05/26 16:32:04.701 STEP: Create a folder for the failed spec if it doesn't exists already @ 02/05/26 16:32:04.701 STEP: Run must-gather because the spec failed @ 02/05/26 16:32:04.702 2026/02/05 16:32:04 Log the present working directory path:- /alabama/cspi/e2e/kubevirt-plugin 2026/02/05 16:32:04 [adm must-gather --dest-dir /alabama/cspi/e2e/kubevirt-plugin/logs/It_Native_CSI_Data_Mover_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-401_kubevirt_Tier1_Started_VM_should_over_ceph_filesytem_mode --image registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3] 2026/02/05 16:32:15 Log all the files present in /alabama/cspi/e2e/kubevirt-plugin/logs directory 2026/02/05 16:32:15 It_Native_CSI_Data_Mover_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-401_kubevirt_Tier1_Started_VM_should_over_ceph_filesytem_mode STEP: Find must-gather folder and rename it to a shorter more readable name @ 02/05/26 16:32:15.449 The folder logs/It_Native_CSI_Data_Mover_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-401_kubevirt_Tier1_Started_VM_should_over_ceph_filesytem_mode/must-gather already exists, skipping renaming the folder < Exit [JustAfterEach] TOP-LEVEL @ 02/05/26 16:32:15.449 (10.748s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:32:15.449 2026/02/05 16:32:15 Cleaning app 2026/02/05 16:32:15 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11  30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11  40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18  49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}"  ^ column 18  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Cleanup resources] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/cleanup.yml for localhost [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-401] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=22  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026/02/05 16:33:02 2026-02-05 16:32:17,195 p=22791 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:32:17,195 p=22791 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:32:17,522 p=22791 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:32:17,522 p=22791 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:32:17,844 p=22791 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:32:17,844 p=22791 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:32:18,165 p=22791 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:32:18,166 p=22791 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:32:18,184 p=22791 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:32:18,184 p=22791 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:32:18,184 p=22791 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:32:18,205 p=22791 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:32:18,206 p=22791 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:32:18,220 p=22791 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:32:18,221 p=22791 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:32:18,685 p=22791 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:32:18,686 p=22791 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:32:18,686 p=22791 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:32:18,686 p=22791 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:32:18,714 p=22791 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:32:18,714 p=22791 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:32:18,736 p=22791 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:32:18,736 p=22791 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:32:18,739 p=22791 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:32:19,348 p=22791 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:32:19,349 p=22791 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:32:19,603 p=22791 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** 2026-02-05 16:32:19,603 p=22791 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:32:19,873 p=22791 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** 2026-02-05 16:32:19,873 p=22791 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:32:20,254 p=22791 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** 2026-02-05 16:32:20,255 p=22791 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11 30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:32:20,255 p=22791 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:32:20,626 p=22791 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** 2026-02-05 16:32:20,626 p=22791 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11 40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:32:20,626 p=22791 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:32:20,651 p=22791 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** 2026-02-05 16:32:20,652 p=22791 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18 49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}" ^ column 18 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:32:20,652 p=22791 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:32:20,672 p=22791 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Cleanup resources] *** 2026-02-05 16:32:20,681 p=22791 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/cleanup.yml for localhost 2026-02-05 16:33:01,904 p=22791 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-401] *** 2026-02-05 16:33:01,904 p=22791 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:33:01,905 p=22791 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:33:01,905 p=22791 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:33:01,905 p=22791 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:33:01,905 p=22791 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:33:01,967 p=22791 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:33:01,967 p=22791 u=1001930000 n=ansible INFO| localhost : ok=22 changed=5 unreachable=0 failed=0 skipped=6 rescued=0 ignored=0 < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:33:02.032 (46.583s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:33:02.032 2026/02/05 16:33:02 Cleaning setup resources for the backup 2026/02/05 16:33:02 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 16:33:02 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2026/02/05 16:33:02 Deleting VolumeSnapshotClass 'example-snapclass' < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:33:02.065 (33ms) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:33:02.065 2026/02/05 16:33:02 Deleting DPA CR < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:33:02.075 (10ms) Attempt #2 Failed. Retrying ↺ @ 02/05/26 16:33:02.075 > Enter [JustBeforeEach] TOP-LEVEL @ 02/05/26 16:33:02.075 < Exit [JustBeforeEach] TOP-LEVEL @ 02/05/26 16:33:02.075 (0s) > Enter [It] [tc-id:OADP-401] [kubevirt] [Tier1] Started VM should over ceph filesytem mode @ 02/05/26 16:33:02.075 2026/02/05 16:33:02 Delete all downloadrequest No download requests are found STEP: Create DPA CR @ 02/05/26 16:33:02.081 2026/02/05 16:33:02 native-datamover 2026/02/05 16:33:02 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "16c7ddc3-cb2a-4e69-be4f-aa508bb671b5", "resourceVersion": "75606", "generation": 1, "creationTimestamp": "2026-02-05T16:33:02Z", "managedFields": [ { "manager": "kubevirt-plugin.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T16:33:02Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:nodeAgent": { ".": {}, "f:enable": {}, "f:podConfig": { ".": {}, "f:resourceAllocations": {} }, "f:uploaderType": {} }, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "kubevirt" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false }, "nodeAgent": { "enable": true, "podConfig": { "resourceAllocations": {} }, "uploaderType": "kopia" } }, "features": null, "logFormat": "text" }, "status": {} } Delete all the backups that remained in the phase InProgress Deleting backup CRs in progress Deletion of backup CRs in progress completed Delete all the restores that remained in the phase InProgress Deleting restore CRs in progress Deletion of restore CRs in progress completed STEP: Verify DPA CR setup @ 02/05/26 16:33:02.174 2026/02/05 16:33:02 Waiting for velero pod to be running 2026/02/05 16:33:02 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete' 2026/02/05 16:33:02 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "16c7ddc3-cb2a-4e69-be4f-aa508bb671b5", "resourceVersion": "75606", "generation": 1, "creationTimestamp": "2026-02-05T16:33:02Z", "managedFields": [ { "manager": "kubevirt-plugin.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T16:33:02Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:nodeAgent": { ".": {}, "f:enable": {}, "f:podConfig": { ".": {}, "f:resourceAllocations": {} }, "f:uploaderType": {} }, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "kubevirt" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false }, "nodeAgent": { "enable": true, "podConfig": { "resourceAllocations": {} }, "uploaderType": "kopia" } }, "features": null, "logFormat": "text" }, "status": {} } 2026/02/05 16:33:07 DPA successfully reconciled STEP: Prepare backup resources, depending on the volumes backup type @ 02/05/26 16:33:07.246 2026/02/05 16:33:07 Snapclass 'example-snapclass' doesn't exist, creating 2026/02/05 16:33:07 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 16:33:07 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2026/02/05 16:33:07 Checking for correct number of running NodeAgent pods... STEP: Installing application for case ocp-kubevirt @ 02/05/26 16:33:07.486 2026/02/05 16:33:07 🔄 [Attempt 1/3] Executing operation: Deploy application ocp-kubevirt 2026/02/05 16:33:07 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11  30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11  40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18  49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}"  ^ column 18  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create resources] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml for localhost [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create namespace] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Deploy VM test-vm] *** changed: [localhost] FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (60 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (59 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (58 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (57 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (56 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (55 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (54 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (53 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:44:11  42 --command "echo '{{ text_content }}' > {{ file_path }}" 43 environment: 44 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  FAILED - RETRYING: [localhost]: Run echo command on the VM (60 retries left). FAILED - RETRYING: [localhost]: Run echo command on the VM (59 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Run echo command on the VM] *** changed: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:60:11  58 --command "cat {{ file_path }}" 59 environment: 60 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify file creation and content] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Display confirmation message] *** ok: [localhost] => {  "msg": "Text content written to '/home/fedora/test' on the VM 'test-vm' successfully." } PLAY RECAP ********************************************************************* localhost : ok=27  changed=8  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026/02/05 16:34:22 2026-02-05 16:33:09,222 p=23067 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:33:09,222 p=23067 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:33:09,541 p=23067 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:33:09,541 p=23067 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:33:09,857 p=23067 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:33:09,857 p=23067 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:33:10,179 p=23067 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:33:10,179 p=23067 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:33:10,199 p=23067 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:33:10,200 p=23067 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:33:10,200 p=23067 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:33:10,220 p=23067 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:33:10,220 p=23067 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:33:10,234 p=23067 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:33:10,235 p=23067 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:33:10,669 p=23067 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:33:10,669 p=23067 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:33:10,670 p=23067 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:33:10,670 p=23067 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:33:10,699 p=23067 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:33:10,699 p=23067 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:33:10,722 p=23067 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:33:10,722 p=23067 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:33:10,725 p=23067 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:33:11,330 p=23067 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:33:11,331 p=23067 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:33:11,590 p=23067 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** 2026-02-05 16:33:11,591 p=23067 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:33:11,853 p=23067 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** 2026-02-05 16:33:11,853 p=23067 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:33:12,223 p=23067 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** 2026-02-05 16:33:12,224 p=23067 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11 30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:33:12,224 p=23067 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:33:12,591 p=23067 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** 2026-02-05 16:33:12,592 p=23067 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11 40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:33:12,592 p=23067 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:33:12,616 p=23067 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** 2026-02-05 16:33:12,617 p=23067 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18 49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}" ^ column 18 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:33:12,617 p=23067 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:33:12,653 p=23067 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create resources] *** 2026-02-05 16:33:12,670 p=23067 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml for localhost 2026-02-05 16:33:13,828 p=23067 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create namespace] *** 2026-02-05 16:33:13,829 p=23067 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:33:13,829 p=23067 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:33:13,829 p=23067 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:33:13,829 p=23067 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:33:13,830 p=23067 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:33:14,882 p=23067 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Deploy VM test-vm] *** 2026-02-05 16:33:14,883 p=23067 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:33:15,975 p=23067 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (60 retries left). 2026-02-05 16:33:21,889 p=23067 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (59 retries left). 2026-02-05 16:33:27,811 p=23067 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (58 retries left). 2026-02-05 16:33:33,696 p=23067 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (57 retries left). 2026-02-05 16:33:39,603 p=23067 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (56 retries left). 2026-02-05 16:33:45,497 p=23067 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (55 retries left). 2026-02-05 16:33:51,384 p=23067 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (54 retries left). 2026-02-05 16:33:57,386 p=23067 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (53 retries left). 2026-02-05 16:34:03,358 p=23067 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** 2026-02-05 16:34:03,358 p=23067 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:34:06,887 p=23067 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Run echo command on the VM (60 retries left). 2026-02-05 16:34:15,466 p=23067 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Run echo command on the VM (59 retries left). 2026-02-05 16:34:21,784 p=23067 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Run echo command on the VM] *** 2026-02-05 16:34:21,784 p=23067 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:44:11 42 --command "echo '{{ text_content }}' > {{ file_path }}" 43 environment: 44 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:34:21,784 p=23067 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:34:22,397 p=23067 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify file creation and content] *** 2026-02-05 16:34:22,398 p=23067 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:60:11 58 --command "cat {{ file_path }}" 59 environment: 60 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:34:22,398 p=23067 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:34:22,420 p=23067 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Display confirmation message] *** 2026-02-05 16:34:22,420 p=23067 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Text content written to '/home/fedora/test' on the VM 'test-vm' successfully." } 2026-02-05 16:34:22,490 p=23067 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:34:22,490 p=23067 u=1001930000 n=ansible INFO| localhost : ok=27 changed=8 unreachable=0 failed=0 skipped=7 rescued=0 ignored=0 STEP: Verify Application deployment @ 02/05/26 16:34:22.636 2026/02/05 16:34:22 Using admin kubeconfig for with_validate operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11  30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11  40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18  49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}"  ^ column 18  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Validate migration] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml for localhost [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to have AgentConnected status True indicating the guest agent is running] *** [ERROR]: Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result.  Task failed. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:33:3  31 when: vm_running | bool 32 33 - name: Wait for VM to have AgentConnected status True indicating the guest agent is running  ^ column 3  <<< caused by >>>  Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10  41 verify_ssl: no 42 register: vm 43 until: vm.resources[0].status.conditions | selectattr('type', 'equalto', 'AgentConnected') | selectattr('status'...  ^ column 10  Broken conditionals can be temporarily allowed with the `ALLOW_BROKEN_CONDITIONALS` configuration option.  fatal: [localhost]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result."} PLAY RECAP ********************************************************************* localhost : ok=22  changed=4  unreachable=0 failed=1  skipped=6  rescued=0 ignored=0 2026/02/05 16:34:34 2026-02-05 16:34:24,820 p=23623 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:34:24,821 p=23623 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:34:25,220 p=23623 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:34:25,220 p=23623 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:34:25,675 p=23623 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:34:25,675 p=23623 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:34:26,260 p=23623 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:34:26,260 p=23623 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:34:26,290 p=23623 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:34:26,291 p=23623 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:34:26,291 p=23623 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:34:26,324 p=23623 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:34:26,325 p=23623 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:34:26,350 p=23623 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:34:26,351 p=23623 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:34:27,040 p=23623 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:34:27,041 p=23623 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:34:27,041 p=23623 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:34:27,041 p=23623 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:34:27,097 p=23623 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:34:27,097 p=23623 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:34:27,136 p=23623 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:34:27,137 p=23623 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:34:27,141 p=23623 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:34:28,061 p=23623 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:34:28,062 p=23623 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:34:28,534 p=23623 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** 2026-02-05 16:34:28,534 p=23623 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:34:28,952 p=23623 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** 2026-02-05 16:34:28,953 p=23623 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:34:29,609 p=23623 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** 2026-02-05 16:34:29,610 p=23623 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11 30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:34:29,610 p=23623 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:34:30,249 p=23623 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** 2026-02-05 16:34:30,250 p=23623 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11 40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:34:30,250 p=23623 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:34:30,293 p=23623 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** 2026-02-05 16:34:30,295 p=23623 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18 49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}" ^ column 18 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:34:30,295 p=23623 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:34:30,403 p=23623 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Validate migration] *** 2026-02-05 16:34:30,426 p=23623 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml for localhost 2026-02-05 16:34:32,363 p=23623 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** 2026-02-05 16:34:32,364 p=23623 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:34:32,364 p=23623 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:34:32,365 p=23623 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:34:32,365 p=23623 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:34:32,365 p=23623 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:34:33,955 p=23623 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to have AgentConnected status True indicating the guest agent is running] *** 2026-02-05 16:34:33,956 p=23623 u=1001930000 n=ansible ERROR| [ERROR]: Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result. Task failed. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:33:3 31 when: vm_running | bool 32 33 - name: Wait for VM to have AgentConnected status True indicating the guest agent is running ^ column 3 <<< caused by >>> Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10 41 verify_ssl: no 42 register: vm 43 until: vm.resources[0].status.conditions | selectattr('type', 'equalto', 'AgentConnected') | selectattr('status'... ^ column 10 Broken conditionals can be temporarily allowed with the `ALLOW_BROKEN_CONDITIONALS` configuration option. 2026-02-05 16:34:33,957 p=23623 u=1001930000 n=ansible INFO| fatal: [localhost]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result."} 2026-02-05 16:34:33,958 p=23623 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:34:33,958 p=23623 u=1001930000 n=ansible INFO| localhost : ok=22 changed=4 unreachable=0 failed=1 skipped=6 rescued=0 ignored=0 Run the command: oc get event -n test-oadp-401 2026/02/05 16:34:34 LAST SEEN TYPE REASON OBJECT MESSAGE 79s Warning FailedScheduling pod/importer-prime-5f1e0a49-cf7f-4a7a-853d-5190d5d8db15 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 79s Warning FailedScheduling pod/importer-prime-5f1e0a49-cf7f-4a7a-853d-5190d5d8db15 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 79s Warning FailedScheduling pod/importer-prime-5f1e0a49-cf7f-4a7a-853d-5190d5d8db15 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 79s Normal Scheduled pod/importer-prime-5f1e0a49-cf7f-4a7a-853d-5190d5d8db15 Successfully assigned test-oadp-401/importer-prime-5f1e0a49-cf7f-4a7a-853d-5190d5d8db15 to ip-10-0-60-83.us-east-2.compute.internal 79s Normal SuccessfulAttachVolume pod/importer-prime-5f1e0a49-cf7f-4a7a-853d-5190d5d8db15 AttachVolume.Attach succeeded for volume "pvc-2db3da2b-15d6-44ab-a0e5-de0ffbf36b92" 68s Normal AddedInterface pod/importer-prime-5f1e0a49-cf7f-4a7a-853d-5190d5d8db15 Add eth0 [10.129.2.93/23] from ovn-kubernetes 68s Normal Pulled pod/importer-prime-5f1e0a49-cf7f-4a7a-853d-5190d5d8db15 Container image "registry.redhat.io/container-native-virtualization/virt-cdi-importer-rhel9@sha256:84d3534ff8027475d41f6dee3c827640905b98dc5251c6a31abad5c7d4cdb2dc" already present on machine 68s Normal Created pod/importer-prime-5f1e0a49-cf7f-4a7a-853d-5190d5d8db15 Created container: init 68s Normal Started pod/importer-prime-5f1e0a49-cf7f-4a7a-853d-5190d5d8db15 Started container init 68s Normal Pulled pod/importer-prime-5f1e0a49-cf7f-4a7a-853d-5190d5d8db15 Container image "registry.redhat.io/container-native-virtualization/virt-cdi-importer-rhel9@sha256:84d3534ff8027475d41f6dee3c827640905b98dc5251c6a31abad5c7d4cdb2dc" already present on machine 68s Normal Created pod/importer-prime-5f1e0a49-cf7f-4a7a-853d-5190d5d8db15 Created container: importer 68s Normal Started pod/importer-prime-5f1e0a49-cf7f-4a7a-853d-5190d5d8db15 Started container importer 68s Normal Pulled pod/importer-prime-5f1e0a49-cf7f-4a7a-853d-5190d5d8db15 Container image "quay.io/kubevirt/fedora-with-test-tooling-container-disk" already present on machine 68s Normal Created pod/importer-prime-5f1e0a49-cf7f-4a7a-853d-5190d5d8db15 Created container: server 68s Normal Started pod/importer-prime-5f1e0a49-cf7f-4a7a-853d-5190d5d8db15 Started container server 80s Normal Provisioning persistentvolumeclaim/prime-5f1e0a49-cf7f-4a7a-853d-5190d5d8db15 External provisioner is provisioning volume for claim "test-oadp-401/prime-5f1e0a49-cf7f-4a7a-853d-5190d5d8db15" 79s Normal ExternalProvisioning persistentvolumeclaim/prime-5f1e0a49-cf7f-4a7a-853d-5190d5d8db15 Waiting for a volume to be created either by the external provisioner 'openshift-storage.cephfs.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 79s Normal ProvisioningSucceeded persistentvolumeclaim/prime-5f1e0a49-cf7f-4a7a-853d-5190d5d8db15 Successfully provisioned volume pvc-2db3da2b-15d6-44ab-a0e5-de0ffbf36b92 51s Normal ImportSucceeded persistentvolumeclaim/prime-5f1e0a49-cf7f-4a7a-853d-5190d5d8db15 Import Successful 41s Warning ClaimMisbound persistentvolumeclaim/prime-5f1e0a49-cf7f-4a7a-853d-5190d5d8db15 Two claims are bound to the same volume, this one is bound incorrectly 49s Warning UnrecognizedDataSourceKind persistentvolumeclaim/test-vm-dv The datasource for this PVC does not match any registered VolumePopulator 80s Normal CreatedPVCPrimeSuccessfully persistentvolumeclaim/test-vm-dv PVC Prime created successfully 80s Normal NotFound datavolume/test-vm-dv No PVC found 49s Normal Provisioning persistentvolumeclaim/test-vm-dv External provisioner is provisioning volume for claim "test-oadp-401/test-vm-dv" 49s Normal Provisioning persistentvolumeclaim/test-vm-dv Assuming an external populator will provision the volume 49s Normal ExternalProvisioning persistentvolumeclaim/test-vm-dv Waiting for a volume to be created either by the external provisioner 'openshift-storage.cephfs.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 80s Normal Pending datavolume/test-vm-dv PVC test-vm-dv Pending 79s Normal ImportScheduled datavolume/test-vm-dv Import into test-vm-dv scheduled 67s Normal ImportInProgress datavolume/test-vm-dv Import into test-vm-dv in progress 53s Warning Completed datavolume/test-vm-dv Import Complete 49s Normal ImportSucceeded datavolume/test-vm-dv Successfully imported into PVC test-vm-dv 41s Normal importSucceeded persistentvolumeclaim/test-vm-dv Successfully imported into test-vm-dv 49s Normal Bound datavolume/test-vm-dv PVC test-vm-dv Bound 80s Normal SuccessfulDataVolumeCreate virtualmachine/test-vm Created DataVolume test-vm-dv 49s Normal SuccessfulCreate virtualmachine/test-vm Started the virtual machine by creating the new virtual machine instance test-vm 49s Normal SuccessfulCreate virtualmachineinstance/test-vm Created virtual machine pod virt-launcher-test-vm-5t4st 33s Normal Created virtualmachineinstance/test-vm VirtualMachineInstance defined. 11s Warning Migrated virtualmachineinstance/test-vm EvictionStrategy is set but vmi is not migratable; cannot migrate VMI: PVC test-vm-dv is not shared, live migration requires that all PVCs must be shared (using ReadWriteMany access mode) 33s Normal Started virtualmachineinstance/test-vm VirtualMachineInstance started. 48s Normal Scheduled pod/virt-launcher-test-vm-5t4st Successfully assigned test-oadp-401/virt-launcher-test-vm-5t4st to ip-10-0-60-83.us-east-2.compute.internal 48s Normal SuccessfulAttachVolume pod/virt-launcher-test-vm-5t4st AttachVolume.Attach succeeded for volume "pvc-2db3da2b-15d6-44ab-a0e5-de0ffbf36b92" 37s Normal AddedInterface pod/virt-launcher-test-vm-5t4st Add eth0 [10.129.2.94/23] from ovn-kubernetes 37s Normal Pulled pod/virt-launcher-test-vm-5t4st Container image "registry.redhat.io/container-native-virtualization/virt-launcher-rhel9@sha256:3138ad3a4471ca69be37fbe50a96be4b89e120de0e2808067ca99ff576f16256" already present on machine 37s Normal Created pod/virt-launcher-test-vm-5t4st Created container: guest-console-log 37s Normal Started pod/virt-launcher-test-vm-5t4st Started container guest-console-log 36s Normal Pulled pod/virt-launcher-test-vm-5t4st Container image "registry.redhat.io/container-native-virtualization/virt-launcher-rhel9@sha256:3138ad3a4471ca69be37fbe50a96be4b89e120de0e2808067ca99ff576f16256" already present on machine 36s Normal Created pod/virt-launcher-test-vm-5t4st Created container: compute 36s Normal Started pod/virt-launcher-test-vm-5t4st Started container compute [FAILED] in [It] - /alabama/cspi/test_common/backup_restore_app_case.go:52 @ 02/05/26 16:34:34.38 < Exit [It] [tc-id:OADP-401] [kubevirt] [Tier1] Started VM should over ceph filesytem mode @ 02/05/26 16:34:34.381 (1m32.305s) > Enter [JustAfterEach] TOP-LEVEL @ 02/05/26 16:34:34.381 2026/02/05 16:34:34 Using Must-gather image: registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 STEP: Get the failed spec name @ 02/05/26 16:34:34.381 2026/02/05 16:34:34 The failed spec name is: Native CSI Data Mover: Backup/Restore Openshift Virtualization Workloads [tc-id:OADP-401] [kubevirt] [Tier1] Started VM should over ceph filesytem mode STEP: Create a folder for all must-gather files if it doesn't exists already @ 02/05/26 16:34:34.381 STEP: Create a folder for the failed spec if it doesn't exists already @ 02/05/26 16:34:34.381 STEP: Run must-gather because the spec failed @ 02/05/26 16:34:34.381 2026/02/05 16:34:34 Log the present working directory path:- /alabama/cspi/e2e/kubevirt-plugin 2026/02/05 16:34:34 [adm must-gather --dest-dir /alabama/cspi/e2e/kubevirt-plugin/logs/It_Native_CSI_Data_Mover_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-401_kubevirt_Tier1_Started_VM_should_over_ceph_filesytem_mode --image registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3] 2026/02/05 16:34:45 Log all the files present in /alabama/cspi/e2e/kubevirt-plugin/logs directory 2026/02/05 16:34:45 It_Native_CSI_Data_Mover_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-401_kubevirt_Tier1_Started_VM_should_over_ceph_filesytem_mode STEP: Find must-gather folder and rename it to a shorter more readable name @ 02/05/26 16:34:45.507 The folder logs/It_Native_CSI_Data_Mover_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-401_kubevirt_Tier1_Started_VM_should_over_ceph_filesytem_mode/must-gather already exists, skipping renaming the folder < Exit [JustAfterEach] TOP-LEVEL @ 02/05/26 16:34:45.507 (11.126s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:34:45.507 2026/02/05 16:34:45 Cleaning app 2026/02/05 16:34:45 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11  30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11  40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18  49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}"  ^ column 18  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Cleanup resources] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/cleanup.yml for localhost [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-401] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=22  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026/02/05 16:35:19 2026-02-05 16:34:47,829 p=23941 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:34:47,829 p=23941 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:34:48,305 p=23941 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:34:48,305 p=23941 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:34:48,773 p=23941 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:34:48,773 p=23941 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:34:49,216 p=23941 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:34:49,216 p=23941 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:34:49,237 p=23941 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:34:49,237 p=23941 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:34:49,237 p=23941 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:34:49,269 p=23941 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:34:49,270 p=23941 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:34:49,291 p=23941 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:34:49,292 p=23941 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:34:49,855 p=23941 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:34:49,855 p=23941 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:34:49,856 p=23941 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:34:49,856 p=23941 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:34:49,890 p=23941 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:34:49,891 p=23941 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:34:49,921 p=23941 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:34:49,921 p=23941 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:34:49,926 p=23941 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:34:50,673 p=23941 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:34:50,673 p=23941 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:34:51,025 p=23941 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** 2026-02-05 16:34:51,025 p=23941 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:34:51,427 p=23941 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** 2026-02-05 16:34:51,427 p=23941 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:34:51,948 p=23941 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** 2026-02-05 16:34:51,949 p=23941 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11 30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:34:51,949 p=23941 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:34:52,431 p=23941 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** 2026-02-05 16:34:52,432 p=23941 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11 40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:34:52,432 p=23941 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:34:52,463 p=23941 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** 2026-02-05 16:34:52,464 p=23941 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18 49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}" ^ column 18 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:34:52,464 p=23941 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:34:52,500 p=23941 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Cleanup resources] *** 2026-02-05 16:34:52,514 p=23941 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/cleanup.yml for localhost 2026-02-05 16:35:19,376 p=23941 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-401] *** 2026-02-05 16:35:19,377 p=23941 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:35:19,377 p=23941 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:35:19,377 p=23941 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:35:19,378 p=23941 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:35:19,378 p=23941 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:35:19,445 p=23941 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:35:19,445 p=23941 u=1001930000 n=ansible INFO| localhost : ok=22 changed=5 unreachable=0 failed=0 skipped=6 rescued=0 ignored=0 < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:35:19.552 (34.046s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:35:19.552 2026/02/05 16:35:19 Cleaning setup resources for the backup 2026/02/05 16:35:19 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 16:35:19 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2026/02/05 16:35:19 Deleting VolumeSnapshotClass 'example-snapclass' < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:35:19.622 (70ms) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:35:19.622 2026/02/05 16:35:19 Deleting DPA CR < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:35:19.633 (11ms) • [FAILED] [454.409 seconds] Native CSI Data Mover: Backup/Restore Openshift Virtualization Workloads  [It] [tc-id:OADP-401] [kubevirt] [Tier1] Started VM should over ceph filesytem mode /alabama/cspi/e2e/kubevirt-plugin/backup_restore_datamover.go:129 [FAILED] Unexpected error: <*errors.Error | 0xc000a90100>: Error during command execution: ansible-playbook error: one or more host failed Command executed: /usr/local/bin/ansible-playbook --extra-vars {"admin_kubeconfig":"/home/jenkins/.kube/config","namespace":"test-oadp-401","non_admin_user":false,"storage_class":"odf-operator-cephfs","use_role":"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt","user_kubeconfig":"/home/jenkins/.kube/config","vm_disk_pvc_volume_mode":"Filesystem","with_validate":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml exit status 2 { context: "(DefaultExecute::Execute)", message: "Error during command execution: ansible-playbook error: one or more host failed\n\nCommand executed: /usr/local/bin/ansible-playbook --extra-vars {\"admin_kubeconfig\":\"/home/jenkins/.kube/config\",\"namespace\":\"test-oadp-401\",\"non_admin_user\":false,\"storage_class\":\"odf-operator-cephfs\",\"use_role\":\"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt\",\"user_kubeconfig\":\"/home/jenkins/.kube/config\",\"vm_disk_pvc_volume_mode\":\"Filesystem\",\"with_validate\":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml\n\nexit status 2", wrappedErrors: nil, } occurred In [It] at: /alabama/cspi/test_common/backup_restore_app_case.go:52 @ 02/05/26 16:34:34.38 There were additional failures detected. To view them in detail run ginkgo -vv ------------------------------ CSI: Backup/Restore Openshift Virtualization Workloads  [tc-id:OADP-185] [kubevirt] [Tier0] [vf:vm] Backing up started VM should succeed /alabama/cspi/e2e/kubevirt-plugin/backup_restore_csi.go:34 > Enter [BeforeEach] CSI: Backup/Restore Openshift Virtualization Workloads @ 02/05/26 16:35:19.634 < Exit [BeforeEach] CSI: Backup/Restore Openshift Virtualization Workloads @ 02/05/26 16:35:19.652 (18ms) > Enter [JustBeforeEach] TOP-LEVEL @ 02/05/26 16:35:19.652 < Exit [JustBeforeEach] TOP-LEVEL @ 02/05/26 16:35:19.652 (0s) > Enter [It] [tc-id:OADP-185] [kubevirt] [Tier0] [vf:vm] Backing up started VM should succeed @ 02/05/26 16:35:19.652 2026/02/05 16:35:19 Delete all downloadrequest No download requests are found STEP: Create DPA CR @ 02/05/26 16:35:19.659 2026/02/05 16:35:19 csi 2026/02/05 16:35:19 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "df406aa2-8e55-4d64-a633-e1107e19707d", "resourceVersion": "78190", "generation": 1, "creationTimestamp": "2026-02-05T16:35:19Z", "managedFields": [ { "manager": "kubevirt-plugin.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T16:35:19Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "kubevirt" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false } }, "features": null, "logFormat": "text" }, "status": {} } Delete all the backups that remained in the phase InProgress Deleting backup CRs in progress Deletion of backup CRs in progress completed Delete all the restores that remained in the phase InProgress Deleting restore CRs in progress Deletion of restore CRs in progress completed STEP: Verify DPA CR setup @ 02/05/26 16:35:19.766 2026/02/05 16:35:19 Waiting for velero pod to be running 2026/02/05 16:35:19 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete' 2026/02/05 16:35:19 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "df406aa2-8e55-4d64-a633-e1107e19707d", "resourceVersion": "78190", "generation": 1, "creationTimestamp": "2026-02-05T16:35:19Z", "managedFields": [ { "manager": "kubevirt-plugin.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T16:35:19Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "kubevirt" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false } }, "features": null, "logFormat": "text" }, "status": {} } 2026/02/05 16:35:24 DPA successfully reconciled STEP: Prepare backup resources, depending on the volumes backup type @ 02/05/26 16:35:24.796 Run the command: oc get ns openshift-storage &> /dev/null && echo true || echo false 2026/02/05 16:35:24 The 'openshift-storage' namespace exists 2026/02/05 16:35:24 Checking default storage class count 2026/02/05 16:35:24 Using the CSI driver: openshift-storage.rbd.csi.ceph.com 2026/02/05 16:35:24 Snapclass 'example-snapclass' doesn't exist, creating 2026/02/05 16:35:25 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 16:35:25 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd STEP: Installing application for case ocp-kubevirt @ 02/05/26 16:35:25.06 2026/02/05 16:35:25 🔄 [Attempt 1/3] Executing operation: Deploy application ocp-kubevirt 2026/02/05 16:35:25 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11  30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11  40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18  49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}"  ^ column 18  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create resources] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml for localhost [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create namespace] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Deploy VM test-vm] *** changed: [localhost] FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (60 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (59 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (58 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (57 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (56 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:44:11  42 --command "echo '{{ text_content }}' > {{ file_path }}" 43 environment: 44 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  FAILED - RETRYING: [localhost]: Run echo command on the VM (60 retries left). FAILED - RETRYING: [localhost]: Run echo command on the VM (59 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Run echo command on the VM] *** changed: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:60:11  58 --command "cat {{ file_path }}" 59 environment: 60 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify file creation and content] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Display confirmation message] *** ok: [localhost] => {  "msg": "Text content written to '/home/fedora/test' on the VM 'test-vm' successfully." } PLAY RECAP ********************************************************************* localhost : ok=27  changed=8  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026/02/05 16:36:22 2026-02-05 16:35:26,967 p=24218 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:35:26,967 p=24218 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:35:27,321 p=24218 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:35:27,321 p=24218 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:35:27,660 p=24218 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:35:27,660 p=24218 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:35:28,017 p=24218 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:35:28,017 p=24218 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:35:28,036 p=24218 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:35:28,036 p=24218 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:35:28,036 p=24218 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:35:28,058 p=24218 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:35:28,058 p=24218 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:35:28,074 p=24218 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:35:28,074 p=24218 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:35:28,595 p=24218 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:35:28,596 p=24218 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:35:28,596 p=24218 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:35:28,596 p=24218 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:35:28,629 p=24218 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:35:28,629 p=24218 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:35:28,653 p=24218 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:35:28,654 p=24218 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:35:28,657 p=24218 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:35:29,290 p=24218 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:35:29,290 p=24218 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:35:29,558 p=24218 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** 2026-02-05 16:35:29,558 p=24218 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:35:29,835 p=24218 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** 2026-02-05 16:35:29,835 p=24218 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:35:30,253 p=24218 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** 2026-02-05 16:35:30,254 p=24218 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11 30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:35:30,254 p=24218 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:35:30,684 p=24218 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** 2026-02-05 16:35:30,684 p=24218 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11 40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:35:30,684 p=24218 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:35:30,712 p=24218 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** 2026-02-05 16:35:30,712 p=24218 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18 49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}" ^ column 18 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:35:30,712 p=24218 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:35:30,753 p=24218 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create resources] *** 2026-02-05 16:35:30,777 p=24218 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml for localhost 2026-02-05 16:35:32,037 p=24218 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create namespace] *** 2026-02-05 16:35:32,037 p=24218 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:35:32,037 p=24218 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:35:32,038 p=24218 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:35:32,038 p=24218 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:35:32,038 p=24218 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:35:33,179 p=24218 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Deploy VM test-vm] *** 2026-02-05 16:35:33,180 p=24218 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:35:34,270 p=24218 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (60 retries left). 2026-02-05 16:35:40,200 p=24218 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (59 retries left). 2026-02-05 16:35:46,103 p=24218 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (58 retries left). 2026-02-05 16:35:52,003 p=24218 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (57 retries left). 2026-02-05 16:35:57,937 p=24218 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (56 retries left). 2026-02-05 16:36:03,803 p=24218 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** 2026-02-05 16:36:03,804 p=24218 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:36:07,252 p=24218 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Run echo command on the VM (60 retries left). 2026-02-05 16:36:15,647 p=24218 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Run echo command on the VM (59 retries left). 2026-02-05 16:36:21,941 p=24218 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Run echo command on the VM] *** 2026-02-05 16:36:21,941 p=24218 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:44:11 42 --command "echo '{{ text_content }}' > {{ file_path }}" 43 environment: 44 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:36:21,941 p=24218 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:36:22,455 p=24218 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify file creation and content] *** 2026-02-05 16:36:22,456 p=24218 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:60:11 58 --command "cat {{ file_path }}" 59 environment: 60 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:36:22,456 p=24218 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:36:22,473 p=24218 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Display confirmation message] *** 2026-02-05 16:36:22,473 p=24218 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Text content written to '/home/fedora/test' on the VM 'test-vm' successfully." } 2026-02-05 16:36:22,519 p=24218 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:36:22,519 p=24218 u=1001930000 n=ansible INFO| localhost : ok=27 changed=8 unreachable=0 failed=0 skipped=7 rescued=0 ignored=0 STEP: Verify Application deployment @ 02/05/26 16:36:22.578 2026/02/05 16:36:22 Using admin kubeconfig for with_validate operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11  30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11  40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18  49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}"  ^ column 18  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Validate migration] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml for localhost [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to have AgentConnected status True indicating the guest agent is running] *** [ERROR]: Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result.  Task failed. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:33:3  31 when: vm_running | bool 32 33 - name: Wait for VM to have AgentConnected status True indicating the guest agent is running  ^ column 3  <<< caused by >>>  Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10  41 verify_ssl: no 42 register: vm 43 until: vm.resources[0].status.conditions | selectattr('type', 'equalto', 'AgentConnected') | selectattr('status'...  ^ column 10  Broken conditionals can be temporarily allowed with the `ALLOW_BROKEN_CONDITIONALS` configuration option.  fatal: [localhost]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result."} PLAY RECAP ********************************************************************* localhost : ok=22  changed=4  unreachable=0 failed=1  skipped=6  rescued=0 ignored=0 2026/02/05 16:36:29 2026-02-05 16:36:24,255 p=24743 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:36:24,255 p=24743 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:36:24,567 p=24743 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:36:24,567 p=24743 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:36:24,880 p=24743 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:36:24,881 p=24743 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:36:25,189 p=24743 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:36:25,189 p=24743 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:36:25,207 p=24743 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:36:25,207 p=24743 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:36:25,208 p=24743 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:36:25,228 p=24743 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:36:25,228 p=24743 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:36:25,243 p=24743 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:36:25,243 p=24743 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:36:25,684 p=24743 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:36:25,685 p=24743 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:36:25,685 p=24743 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:36:25,685 p=24743 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:36:25,716 p=24743 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:36:25,716 p=24743 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:36:25,737 p=24743 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:36:25,737 p=24743 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:36:25,740 p=24743 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:36:26,341 p=24743 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:36:26,341 p=24743 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:36:26,591 p=24743 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** 2026-02-05 16:36:26,591 p=24743 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:36:26,848 p=24743 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** 2026-02-05 16:36:26,849 p=24743 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:36:27,229 p=24743 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** 2026-02-05 16:36:27,229 p=24743 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11 30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:36:27,229 p=24743 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:36:27,580 p=24743 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** 2026-02-05 16:36:27,581 p=24743 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11 40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:36:27,581 p=24743 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:36:27,606 p=24743 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** 2026-02-05 16:36:27,606 p=24743 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18 49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}" ^ column 18 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:36:27,606 p=24743 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:36:27,660 p=24743 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Validate migration] *** 2026-02-05 16:36:27,672 p=24743 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml for localhost 2026-02-05 16:36:28,753 p=24743 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** 2026-02-05 16:36:28,754 p=24743 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:36:28,754 p=24743 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:36:28,754 p=24743 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:36:28,754 p=24743 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:36:28,754 p=24743 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:36:29,733 p=24743 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to have AgentConnected status True indicating the guest agent is running] *** 2026-02-05 16:36:29,734 p=24743 u=1001930000 n=ansible ERROR| [ERROR]: Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result. Task failed. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:33:3 31 when: vm_running | bool 32 33 - name: Wait for VM to have AgentConnected status True indicating the guest agent is running ^ column 3 <<< caused by >>> Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10 41 verify_ssl: no 42 register: vm 43 until: vm.resources[0].status.conditions | selectattr('type', 'equalto', 'AgentConnected') | selectattr('status'... ^ column 10 Broken conditionals can be temporarily allowed with the `ALLOW_BROKEN_CONDITIONALS` configuration option. 2026-02-05 16:36:29,734 p=24743 u=1001930000 n=ansible INFO| fatal: [localhost]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result."} 2026-02-05 16:36:29,735 p=24743 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:36:29,735 p=24743 u=1001930000 n=ansible INFO| localhost : ok=22 changed=4 unreachable=0 failed=1 skipped=6 rescued=0 ignored=0 Run the command: oc get event -n test-oadp-185 2026/02/05 16:36:29 LAST SEEN TYPE REASON OBJECT MESSAGE 56s Warning FailedScheduling pod/importer-prime-e7a89bf8-6929-49ee-9bde-eb3e8747ce28 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 56s Warning FailedScheduling pod/importer-prime-e7a89bf8-6929-49ee-9bde-eb3e8747ce28 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 56s Normal Scheduled pod/importer-prime-e7a89bf8-6929-49ee-9bde-eb3e8747ce28 Successfully assigned test-oadp-185/importer-prime-e7a89bf8-6929-49ee-9bde-eb3e8747ce28 to ip-10-0-60-83.us-east-2.compute.internal 55s Normal SuccessfulAttachVolume pod/importer-prime-e7a89bf8-6929-49ee-9bde-eb3e8747ce28 AttachVolume.Attach succeeded for volume "pvc-db6dd571-ff95-4c4e-81a8-cb61bb2840b4" 50s Normal SuccessfulMountVolume pod/importer-prime-e7a89bf8-6929-49ee-9bde-eb3e8747ce28 MapVolume.MapPodDevice succeeded for volume "pvc-db6dd571-ff95-4c4e-81a8-cb61bb2840b4" globalMapPath "/var/lib/kubelet/plugins/kubernetes.io/csi/volumeDevices/pvc-db6dd571-ff95-4c4e-81a8-cb61bb2840b4/dev" 50s Normal SuccessfulMountVolume pod/importer-prime-e7a89bf8-6929-49ee-9bde-eb3e8747ce28 MapVolume.MapPodDevice succeeded for volume "pvc-db6dd571-ff95-4c4e-81a8-cb61bb2840b4" volumeMapPath "/var/lib/kubelet/pods/073a76d1-db5d-4f2c-aa2a-f25f07394779/volumeDevices/kubernetes.io~csi" 50s Normal AddedInterface pod/importer-prime-e7a89bf8-6929-49ee-9bde-eb3e8747ce28 Add eth0 [10.129.2.98/23] from ovn-kubernetes 50s Normal Pulled pod/importer-prime-e7a89bf8-6929-49ee-9bde-eb3e8747ce28 Container image "registry.redhat.io/container-native-virtualization/virt-cdi-importer-rhel9@sha256:84d3534ff8027475d41f6dee3c827640905b98dc5251c6a31abad5c7d4cdb2dc" already present on machine 50s Normal Created pod/importer-prime-e7a89bf8-6929-49ee-9bde-eb3e8747ce28 Created container: init 50s Normal Started pod/importer-prime-e7a89bf8-6929-49ee-9bde-eb3e8747ce28 Started container init 49s Normal Pulled pod/importer-prime-e7a89bf8-6929-49ee-9bde-eb3e8747ce28 Container image "registry.redhat.io/container-native-virtualization/virt-cdi-importer-rhel9@sha256:84d3534ff8027475d41f6dee3c827640905b98dc5251c6a31abad5c7d4cdb2dc" already present on machine 49s Normal Created pod/importer-prime-e7a89bf8-6929-49ee-9bde-eb3e8747ce28 Created container: importer 49s Normal Started pod/importer-prime-e7a89bf8-6929-49ee-9bde-eb3e8747ce28 Started container importer 49s Normal Pulled pod/importer-prime-e7a89bf8-6929-49ee-9bde-eb3e8747ce28 Container image "quay.io/kubevirt/fedora-with-test-tooling-container-disk" already present on machine 49s Normal Created pod/importer-prime-e7a89bf8-6929-49ee-9bde-eb3e8747ce28 Created container: server 49s Normal Started pod/importer-prime-e7a89bf8-6929-49ee-9bde-eb3e8747ce28 Started container server 56s Normal Provisioning persistentvolumeclaim/prime-e7a89bf8-6929-49ee-9bde-eb3e8747ce28 External provisioner is provisioning volume for claim "test-oadp-185/prime-e7a89bf8-6929-49ee-9bde-eb3e8747ce28" 56s Normal ExternalProvisioning persistentvolumeclaim/prime-e7a89bf8-6929-49ee-9bde-eb3e8747ce28 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 56s Warning ErrStartingPod persistentvolumeclaim/prime-e7a89bf8-6929-49ee-9bde-eb3e8747ce28 Error starting pod 'importer-prime-e7a89bf8-6929-49ee-9bde-eb3e8747ce28': For more information, request access to cdi-deploy logs from your sysadmin 56s Normal ProvisioningSucceeded persistentvolumeclaim/prime-e7a89bf8-6929-49ee-9bde-eb3e8747ce28 Successfully provisioned volume pvc-db6dd571-ff95-4c4e-81a8-cb61bb2840b4 31s Normal ImportSucceeded persistentvolumeclaim/prime-e7a89bf8-6929-49ee-9bde-eb3e8747ce28 Import Successful 21s Warning ClaimMisbound persistentvolumeclaim/prime-e7a89bf8-6929-49ee-9bde-eb3e8747ce28 Two claims are bound to the same volume, this one is bound incorrectly 15s Warning UnrecognizedDataSourceKind persistentvolumeclaim/test-vm-dv The datasource for this PVC does not match any registered VolumePopulator 56s Normal CreatedPVCPrimeSuccessfully persistentvolumeclaim/test-vm-dv PVC Prime created successfully 31s Normal Provisioning persistentvolumeclaim/test-vm-dv External provisioner is provisioning volume for claim "test-oadp-185/test-vm-dv" 31s Normal Provisioning persistentvolumeclaim/test-vm-dv Assuming an external populator will provision the volume 31s Normal ExternalProvisioning persistentvolumeclaim/test-vm-dv Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 56s Normal NotFound datavolume/test-vm-dv No PVC found 56s Normal Pending datavolume/test-vm-dv PVC test-vm-dv Pending 56s Warning importFailed persistentvolumeclaim/test-vm-dv import into test-vm-dv failed 56s Normal ImportScheduled datavolume/test-vm-dv Import into test-vm-dv scheduled 56s Warning ErrStartingPod datavolume/test-vm-dv Error starting pod 'importer-prime-e7a89bf8-6929-49ee-9bde-eb3e8747ce28': For more information, request access to cdi-deploy logs from your sysadmin 48s Normal ImportInProgress datavolume/test-vm-dv Import into test-vm-dv in progress 33s Warning Completed datavolume/test-vm-dv Import Complete 21s Normal importSucceeded persistentvolumeclaim/test-vm-dv Successfully imported into test-vm-dv 31s Normal ImportSucceeded datavolume/test-vm-dv Successfully imported into PVC test-vm-dv 31s Normal Bound datavolume/test-vm-dv PVC test-vm-dv Bound 56s Normal SuccessfulDataVolumeCreate virtualmachine/test-vm Created DataVolume test-vm-dv 30s Normal SuccessfulCreate virtualmachine/test-vm Started the virtual machine by creating the new virtual machine instance test-vm 30s Normal SuccessfulCreate virtualmachineinstance/test-vm Created virtual machine pod virt-launcher-test-vm-9t6hp 26s Normal Created virtualmachineinstance/test-vm VirtualMachineInstance defined. 3s Warning Migrated virtualmachineinstance/test-vm EvictionStrategy is set but vmi is not migratable; cannot migrate VMI: PVC test-vm-dv is not shared, live migration requires that all PVCs must be shared (using ReadWriteMany access mode) 26s Normal Started virtualmachineinstance/test-vm VirtualMachineInstance started. 30s Normal Scheduled pod/virt-launcher-test-vm-9t6hp Successfully assigned test-oadp-185/virt-launcher-test-vm-9t6hp to ip-10-0-60-83.us-east-2.compute.internal 30s Warning ErrorUpdatingResource pod/virt-launcher-test-vm-9t6hp addLogicalPort failed for test-oadp-185/virt-launcher-test-vm-9t6hp: failed to update pod test-oadp-185/virt-launcher-test-vm-9t6hp: Operation cannot be fulfilled on pods "virt-launcher-test-vm-9t6hp": the object has been modified; please apply your changes to the latest version and try again 30s Normal SuccessfulMountVolume pod/virt-launcher-test-vm-9t6hp MapVolume.MapPodDevice succeeded for volume "pvc-db6dd571-ff95-4c4e-81a8-cb61bb2840b4" globalMapPath "/var/lib/kubelet/plugins/kubernetes.io/csi/volumeDevices/pvc-db6dd571-ff95-4c4e-81a8-cb61bb2840b4/dev" 30s Normal SuccessfulMountVolume pod/virt-launcher-test-vm-9t6hp MapVolume.MapPodDevice succeeded for volume "pvc-db6dd571-ff95-4c4e-81a8-cb61bb2840b4" volumeMapPath "/var/lib/kubelet/pods/232788bb-5b0e-4e51-90a9-c3cc2149dcd6/volumeDevices/kubernetes.io~csi" 30s Normal AddedInterface pod/virt-launcher-test-vm-9t6hp Add eth0 [10.129.2.100/23] from ovn-kubernetes 30s Normal Pulled pod/virt-launcher-test-vm-9t6hp Container image "registry.redhat.io/container-native-virtualization/virt-launcher-rhel9@sha256:3138ad3a4471ca69be37fbe50a96be4b89e120de0e2808067ca99ff576f16256" already present on machine 29s Normal Created pod/virt-launcher-test-vm-9t6hp Created container: guest-console-log 29s Normal Started pod/virt-launcher-test-vm-9t6hp Started container guest-console-log 29s Normal Pulled pod/virt-launcher-test-vm-9t6hp Container image "registry.redhat.io/container-native-virtualization/virt-launcher-rhel9@sha256:3138ad3a4471ca69be37fbe50a96be4b89e120de0e2808067ca99ff576f16256" already present on machine 29s Normal Created pod/virt-launcher-test-vm-9t6hp Created container: compute 29s Normal Started pod/virt-launcher-test-vm-9t6hp Started container compute [FAILED] in [It] - /alabama/cspi/test_common/backup_restore_app_case.go:52 @ 02/05/26 16:36:29.895 < Exit [It] [tc-id:OADP-185] [kubevirt] [Tier0] [vf:vm] Backing up started VM should succeed @ 02/05/26 16:36:29.895 (1m10.243s) > Enter [JustAfterEach] TOP-LEVEL @ 02/05/26 16:36:29.895 2026/02/05 16:36:29 Using Must-gather image: registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 STEP: Get the failed spec name @ 02/05/26 16:36:29.895 2026/02/05 16:36:29 The failed spec name is: CSI: Backup/Restore Openshift Virtualization Workloads [tc-id:OADP-185] [kubevirt] [Tier0] [vf:vm] Backing up started VM should succeed STEP: Create a folder for all must-gather files if it doesn't exists already @ 02/05/26 16:36:29.895 STEP: Create a folder for the failed spec if it doesn't exists already @ 02/05/26 16:36:29.895 2026/02/05 16:36:29 The folder logs/It_CSI_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-185_kubevirt_Tier0_vf_vm_Backing_up_started_VM_should_succeed does not exists, creating new folder with the name: logs/It_CSI_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-185_kubevirt_Tier0_vf_vm_Backing_up_started_VM_should_succeed STEP: Run must-gather because the spec failed @ 02/05/26 16:36:29.895 2026/02/05 16:36:29 Log the present working directory path:- /alabama/cspi/e2e/kubevirt-plugin 2026/02/05 16:36:29 [adm must-gather --dest-dir /alabama/cspi/e2e/kubevirt-plugin/logs/It_CSI_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-185_kubevirt_Tier0_vf_vm_Backing_up_started_VM_should_succeed --image registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3] 2026/02/05 16:36:40 Log all the files present in /alabama/cspi/e2e/kubevirt-plugin/logs directory 2026/02/05 16:36:40 It_CSI_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-185_kubevirt_Tier0_vf_vm_Backing_up_started_VM_should_succeed 2026/02/05 16:36:40 It_Native_CSI_Data_Mover_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-401_kubevirt_Tier1_Started_VM_should_over_ceph_filesytem_mode STEP: Find must-gather folder and rename it to a shorter more readable name @ 02/05/26 16:36:40.652 < Exit [JustAfterEach] TOP-LEVEL @ 02/05/26 16:36:40.652 (10.758s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:36:40.652 2026/02/05 16:36:40 Cleaning app 2026/02/05 16:36:40 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11  30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11  40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18  49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}"  ^ column 18  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Cleanup resources] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/cleanup.yml for localhost [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-185] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=22  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026/02/05 16:37:14 2026-02-05 16:36:42,635 p=25097 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:36:42,635 p=25097 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:36:43,002 p=25097 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:36:43,002 p=25097 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:36:43,352 p=25097 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:36:43,352 p=25097 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:36:43,717 p=25097 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:36:43,717 p=25097 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:36:43,737 p=25097 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:36:43,738 p=25097 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:36:43,738 p=25097 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:36:43,759 p=25097 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:36:43,759 p=25097 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:36:43,776 p=25097 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:36:43,777 p=25097 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:36:44,260 p=25097 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:36:44,261 p=25097 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:36:44,261 p=25097 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:36:44,261 p=25097 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:36:44,300 p=25097 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:36:44,300 p=25097 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:36:44,328 p=25097 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:36:44,328 p=25097 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:36:44,332 p=25097 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:36:44,976 p=25097 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:36:44,977 p=25097 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:36:45,318 p=25097 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** 2026-02-05 16:36:45,318 p=25097 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:36:45,785 p=25097 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** 2026-02-05 16:36:45,785 p=25097 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:36:46,501 p=25097 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** 2026-02-05 16:36:46,502 p=25097 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11 30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:36:46,502 p=25097 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:36:47,165 p=25097 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** 2026-02-05 16:36:47,166 p=25097 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11 40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:36:47,166 p=25097 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:36:47,210 p=25097 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** 2026-02-05 16:36:47,211 p=25097 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18 49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}" ^ column 18 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:36:47,211 p=25097 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:36:47,246 p=25097 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Cleanup resources] *** 2026-02-05 16:36:47,264 p=25097 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/cleanup.yml for localhost 2026-02-05 16:37:14,291 p=25097 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-185] *** 2026-02-05 16:37:14,291 p=25097 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:37:14,292 p=25097 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:37:14,292 p=25097 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:37:14,292 p=25097 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:37:14,293 p=25097 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:37:14,376 p=25097 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:37:14,376 p=25097 u=1001930000 n=ansible INFO| localhost : ok=22 changed=5 unreachable=0 failed=0 skipped=6 rescued=0 ignored=0 < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:37:14.47 (33.818s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:37:14.47 2026/02/05 16:37:14 Cleaning setup resources for the backup 2026/02/05 16:37:14 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 16:37:14 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2026/02/05 16:37:14 Deleting VolumeSnapshotClass 'example-snapclass' < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:37:14.5 (30ms) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:37:14.5 2026/02/05 16:37:14 Deleting DPA CR < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:37:14.513 (12ms) Attempt #1 Failed. Retrying ↺ @ 02/05/26 16:37:14.513 > Enter [BeforeEach] CSI: Backup/Restore Openshift Virtualization Workloads @ 02/05/26 16:37:14.513 < Exit [BeforeEach] CSI: Backup/Restore Openshift Virtualization Workloads @ 02/05/26 16:37:14.531 (18ms) > Enter [JustBeforeEach] TOP-LEVEL @ 02/05/26 16:37:14.531 < Exit [JustBeforeEach] TOP-LEVEL @ 02/05/26 16:37:14.531 (0s) > Enter [It] [tc-id:OADP-185] [kubevirt] [Tier0] [vf:vm] Backing up started VM should succeed @ 02/05/26 16:37:14.531 2026/02/05 16:37:14 Delete all downloadrequest No download requests are found STEP: Create DPA CR @ 02/05/26 16:37:14.539 2026/02/05 16:37:14 csi 2026/02/05 16:37:14 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "04174670-4e24-4749-8da1-c08bc8706de0", "resourceVersion": "80419", "generation": 1, "creationTimestamp": "2026-02-05T16:37:14Z", "managedFields": [ { "manager": "kubevirt-plugin.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T16:37:14Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "kubevirt" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false } }, "features": null, "logFormat": "text" }, "status": {} } Delete all the backups that remained in the phase InProgress Deleting backup CRs in progress Deletion of backup CRs in progress completed Delete all the restores that remained in the phase InProgress Deleting restore CRs in progress Deletion of restore CRs in progress completed STEP: Verify DPA CR setup @ 02/05/26 16:37:14.609 2026/02/05 16:37:14 Waiting for velero pod to be running 2026/02/05 16:37:14 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete' 2026/02/05 16:37:14 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "04174670-4e24-4749-8da1-c08bc8706de0", "resourceVersion": "80419", "generation": 1, "creationTimestamp": "2026-02-05T16:37:14Z", "managedFields": [ { "manager": "kubevirt-plugin.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T16:37:14Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "kubevirt" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false } }, "features": null, "logFormat": "text" }, "status": {} } 2026/02/05 16:37:19 DPA successfully reconciled STEP: Prepare backup resources, depending on the volumes backup type @ 02/05/26 16:37:19.627 2026/02/05 16:37:19 Snapclass 'example-snapclass' doesn't exist, creating 2026/02/05 16:37:19 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 16:37:19 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd STEP: Installing application for case ocp-kubevirt @ 02/05/26 16:37:19.751 2026/02/05 16:37:19 🔄 [Attempt 1/3] Executing operation: Deploy application ocp-kubevirt 2026/02/05 16:37:19 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11  30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11  40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18  49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}"  ^ column 18  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create resources] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml for localhost [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create namespace] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Deploy VM test-vm] *** changed: [localhost] FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (60 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (59 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (58 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (57 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (56 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (55 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:44:11  42 --command "echo '{{ text_content }}' > {{ file_path }}" 43 environment: 44 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  FAILED - RETRYING: [localhost]: Run echo command on the VM (60 retries left). FAILED - RETRYING: [localhost]: Run echo command on the VM (59 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Run echo command on the VM] *** changed: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:60:11  58 --command "cat {{ file_path }}" 59 environment: 60 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify file creation and content] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Display confirmation message] *** ok: [localhost] => {  "msg": "Text content written to '/home/fedora/test' on the VM 'test-vm' successfully." } PLAY RECAP ********************************************************************* localhost : ok=27  changed=8  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026/02/05 16:38:24 2026-02-05 16:37:21,910 p=25368 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:37:21,910 p=25368 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:37:22,256 p=25368 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:37:22,257 p=25368 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:37:22,615 p=25368 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:37:22,615 p=25368 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:37:23,479 p=25368 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:37:23,480 p=25368 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:37:23,498 p=25368 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:37:23,499 p=25368 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:37:23,499 p=25368 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:37:23,519 p=25368 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:37:23,519 p=25368 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:37:23,534 p=25368 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:37:23,535 p=25368 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:37:23,977 p=25368 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:37:23,977 p=25368 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:37:23,977 p=25368 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:37:23,978 p=25368 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:37:24,006 p=25368 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:37:24,006 p=25368 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:37:24,026 p=25368 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:37:24,027 p=25368 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:37:24,029 p=25368 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:37:24,670 p=25368 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:37:24,670 p=25368 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:37:24,981 p=25368 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** 2026-02-05 16:37:24,981 p=25368 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:37:25,321 p=25368 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** 2026-02-05 16:37:25,321 p=25368 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:37:25,736 p=25368 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** 2026-02-05 16:37:25,737 p=25368 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11 30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:37:25,737 p=25368 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:37:26,122 p=25368 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** 2026-02-05 16:37:26,122 p=25368 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11 40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:37:26,123 p=25368 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:37:26,147 p=25368 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** 2026-02-05 16:37:26,148 p=25368 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18 49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}" ^ column 18 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:37:26,148 p=25368 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:37:26,184 p=25368 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create resources] *** 2026-02-05 16:37:26,200 p=25368 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml for localhost 2026-02-05 16:37:27,368 p=25368 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create namespace] *** 2026-02-05 16:37:27,368 p=25368 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:37:27,369 p=25368 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:37:27,369 p=25368 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:37:27,369 p=25368 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:37:27,369 p=25368 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:37:28,558 p=25368 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Deploy VM test-vm] *** 2026-02-05 16:37:28,559 p=25368 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:37:29,724 p=25368 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (60 retries left). 2026-02-05 16:37:35,612 p=25368 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (59 retries left). 2026-02-05 16:37:41,498 p=25368 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (58 retries left). 2026-02-05 16:37:47,884 p=25368 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (57 retries left). 2026-02-05 16:37:54,151 p=25368 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (56 retries left). 2026-02-05 16:38:00,106 p=25368 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (55 retries left). 2026-02-05 16:38:06,068 p=25368 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** 2026-02-05 16:38:06,069 p=25368 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:38:09,506 p=25368 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Run echo command on the VM (60 retries left). 2026-02-05 16:38:17,961 p=25368 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Run echo command on the VM (59 retries left). 2026-02-05 16:38:24,235 p=25368 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Run echo command on the VM] *** 2026-02-05 16:38:24,236 p=25368 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:44:11 42 --command "echo '{{ text_content }}' > {{ file_path }}" 43 environment: 44 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:38:24,236 p=25368 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:38:24,785 p=25368 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify file creation and content] *** 2026-02-05 16:38:24,786 p=25368 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:60:11 58 --command "cat {{ file_path }}" 59 environment: 60 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:38:24,786 p=25368 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:38:24,808 p=25368 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Display confirmation message] *** 2026-02-05 16:38:24,809 p=25368 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Text content written to '/home/fedora/test' on the VM 'test-vm' successfully." } 2026-02-05 16:38:24,871 p=25368 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:38:24,871 p=25368 u=1001930000 n=ansible INFO| localhost : ok=27 changed=8 unreachable=0 failed=0 skipped=7 rescued=0 ignored=0 STEP: Verify Application deployment @ 02/05/26 16:38:24.982 2026/02/05 16:38:24 Using admin kubeconfig for with_validate operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11  30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11  40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18  49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}"  ^ column 18  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Validate migration] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml for localhost [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to have AgentConnected status True indicating the guest agent is running] *** [ERROR]: Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result.  Task failed. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:33:3  31 when: vm_running | bool 32 33 - name: Wait for VM to have AgentConnected status True indicating the guest agent is running  ^ column 3  <<< caused by >>>  Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10  41 verify_ssl: no 42 register: vm 43 until: vm.resources[0].status.conditions | selectattr('type', 'equalto', 'AgentConnected') | selectattr('status'...  ^ column 10  Broken conditionals can be temporarily allowed with the `ALLOW_BROKEN_CONDITIONALS` configuration option.  fatal: [localhost]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result."} PLAY RECAP ********************************************************************* localhost : ok=22  changed=4  unreachable=0 failed=1  skipped=6  rescued=0 ignored=0 2026/02/05 16:38:34 2026-02-05 16:38:27,349 p=25901 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:38:27,350 p=25901 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:38:27,819 p=25901 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:38:27,819 p=25901 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:38:28,266 p=25901 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:38:28,266 p=25901 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:38:28,736 p=25901 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:38:28,736 p=25901 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:38:28,764 p=25901 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:38:28,764 p=25901 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:38:28,765 p=25901 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:38:28,798 p=25901 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:38:28,798 p=25901 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:38:28,819 p=25901 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:38:28,820 p=25901 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:38:29,468 p=25901 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:38:29,469 p=25901 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:38:29,469 p=25901 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:38:29,469 p=25901 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:38:29,516 p=25901 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:38:29,516 p=25901 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:38:29,550 p=25901 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:38:29,550 p=25901 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:38:29,555 p=25901 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:38:30,315 p=25901 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:38:30,315 p=25901 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:38:30,612 p=25901 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** 2026-02-05 16:38:30,612 p=25901 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:38:30,983 p=25901 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** 2026-02-05 16:38:30,983 p=25901 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:38:31,521 p=25901 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** 2026-02-05 16:38:31,522 p=25901 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11 30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:38:31,522 p=25901 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:38:31,906 p=25901 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** 2026-02-05 16:38:31,907 p=25901 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11 40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:38:31,907 p=25901 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:38:31,932 p=25901 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** 2026-02-05 16:38:31,933 p=25901 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18 49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}" ^ column 18 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:38:31,933 p=25901 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:38:31,993 p=25901 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Validate migration] *** 2026-02-05 16:38:32,007 p=25901 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml for localhost 2026-02-05 16:38:33,135 p=25901 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** 2026-02-05 16:38:33,135 p=25901 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:38:33,136 p=25901 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:38:33,136 p=25901 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:38:33,136 p=25901 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:38:33,136 p=25901 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:38:34,154 p=25901 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to have AgentConnected status True indicating the guest agent is running] *** 2026-02-05 16:38:34,155 p=25901 u=1001930000 n=ansible ERROR| [ERROR]: Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result. Task failed. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:33:3 31 when: vm_running | bool 32 33 - name: Wait for VM to have AgentConnected status True indicating the guest agent is running ^ column 3 <<< caused by >>> Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10 41 verify_ssl: no 42 register: vm 43 until: vm.resources[0].status.conditions | selectattr('type', 'equalto', 'AgentConnected') | selectattr('status'... ^ column 10 Broken conditionals can be temporarily allowed with the `ALLOW_BROKEN_CONDITIONALS` configuration option. 2026-02-05 16:38:34,155 p=25901 u=1001930000 n=ansible INFO| fatal: [localhost]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result."} 2026-02-05 16:38:34,156 p=25901 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:38:34,156 p=25901 u=1001930000 n=ansible INFO| localhost : ok=22 changed=4 unreachable=0 failed=1 skipped=6 rescued=0 ignored=0 Run the command: oc get event -n test-oadp-185 2026/02/05 16:38:34 LAST SEEN TYPE REASON OBJECT MESSAGE 65s Warning FailedScheduling pod/importer-prime-a3459581-af16-43be-b788-781cac094559 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 55s Warning FailedScheduling pod/importer-prime-a3459581-af16-43be-b788-781cac094559 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 55s Normal Scheduled pod/importer-prime-a3459581-af16-43be-b788-781cac094559 Successfully assigned test-oadp-185/importer-prime-a3459581-af16-43be-b788-781cac094559 to ip-10-0-60-83.us-east-2.compute.internal 55s Normal SuccessfulAttachVolume pod/importer-prime-a3459581-af16-43be-b788-781cac094559 AttachVolume.Attach succeeded for volume "pvc-01e654c5-6a3a-48fe-839e-f88cc66ed88f" 53s Normal SuccessfulMountVolume pod/importer-prime-a3459581-af16-43be-b788-781cac094559 MapVolume.MapPodDevice succeeded for volume "pvc-01e654c5-6a3a-48fe-839e-f88cc66ed88f" globalMapPath "/var/lib/kubelet/plugins/kubernetes.io/csi/volumeDevices/pvc-01e654c5-6a3a-48fe-839e-f88cc66ed88f/dev" 53s Normal SuccessfulMountVolume pod/importer-prime-a3459581-af16-43be-b788-781cac094559 MapVolume.MapPodDevice succeeded for volume "pvc-01e654c5-6a3a-48fe-839e-f88cc66ed88f" volumeMapPath "/var/lib/kubelet/pods/0a6e0e5e-1852-410f-98e9-8382bb40514b/volumeDevices/kubernetes.io~csi" 52s Normal AddedInterface pod/importer-prime-a3459581-af16-43be-b788-781cac094559 Add eth0 [10.129.2.104/23] from ovn-kubernetes 52s Normal Pulled pod/importer-prime-a3459581-af16-43be-b788-781cac094559 Container image "registry.redhat.io/container-native-virtualization/virt-cdi-importer-rhel9@sha256:84d3534ff8027475d41f6dee3c827640905b98dc5251c6a31abad5c7d4cdb2dc" already present on machine 52s Normal Created pod/importer-prime-a3459581-af16-43be-b788-781cac094559 Created container: init 52s Normal Started pod/importer-prime-a3459581-af16-43be-b788-781cac094559 Started container init 52s Normal Pulled pod/importer-prime-a3459581-af16-43be-b788-781cac094559 Container image "registry.redhat.io/container-native-virtualization/virt-cdi-importer-rhel9@sha256:84d3534ff8027475d41f6dee3c827640905b98dc5251c6a31abad5c7d4cdb2dc" already present on machine 52s Normal Created pod/importer-prime-a3459581-af16-43be-b788-781cac094559 Created container: importer 52s Normal Started pod/importer-prime-a3459581-af16-43be-b788-781cac094559 Started container importer 52s Normal Pulled pod/importer-prime-a3459581-af16-43be-b788-781cac094559 Container image "quay.io/kubevirt/fedora-with-test-tooling-container-disk" already present on machine 52s Normal Created pod/importer-prime-a3459581-af16-43be-b788-781cac094559 Created container: server 52s Normal Started pod/importer-prime-a3459581-af16-43be-b788-781cac094559 Started container server 66s Warning ProvisioningFailed persistentvolumeclaim/prime-a3459581-af16-43be-b788-781cac094559 Error saving claim: Operation cannot be fulfilled on persistentvolumeclaims "prime-a3459581-af16-43be-b788-781cac094559": the object has been modified; please apply your changes to the latest version and try again 56s Normal ExternalProvisioning persistentvolumeclaim/prime-a3459581-af16-43be-b788-781cac094559 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 56s Normal Provisioning persistentvolumeclaim/prime-a3459581-af16-43be-b788-781cac094559 External provisioner is provisioning volume for claim "test-oadp-185/prime-a3459581-af16-43be-b788-781cac094559" 56s Normal ProvisioningSucceeded persistentvolumeclaim/prime-a3459581-af16-43be-b788-781cac094559 Successfully provisioned volume pvc-01e654c5-6a3a-48fe-839e-f88cc66ed88f 34s Normal ImportSucceeded persistentvolumeclaim/prime-a3459581-af16-43be-b788-781cac094559 Import Successful 26s Warning ClaimMisbound persistentvolumeclaim/prime-a3459581-af16-43be-b788-781cac094559 Two claims are bound to the same volume, this one is bound incorrectly 25s Warning UnrecognizedDataSourceKind persistentvolumeclaim/test-vm-dv The datasource for this PVC does not match any registered VolumePopulator 66s Normal NotFound datavolume/test-vm-dv No PVC found 66s Normal CreatedPVCPrimeSuccessfully persistentvolumeclaim/test-vm-dv PVC Prime created successfully 34s Normal Provisioning persistentvolumeclaim/test-vm-dv External provisioner is provisioning volume for claim "test-oadp-185/test-vm-dv" 34s Normal Provisioning persistentvolumeclaim/test-vm-dv Assuming an external populator will provision the volume 34s Normal ExternalProvisioning persistentvolumeclaim/test-vm-dv Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 66s Normal Pending datavolume/test-vm-dv PVC test-vm-dv Pending 56s Normal ImportScheduled datavolume/test-vm-dv Import into test-vm-dv scheduled 51s Normal ImportInProgress datavolume/test-vm-dv Import into test-vm-dv in progress 36s Warning Completed datavolume/test-vm-dv Import Complete 34s Normal ImportSucceeded datavolume/test-vm-dv Successfully imported into PVC test-vm-dv 26s Normal importSucceeded persistentvolumeclaim/test-vm-dv Successfully imported into test-vm-dv 33s Normal Bound datavolume/test-vm-dv PVC test-vm-dv Bound 66s Normal SuccessfulDataVolumeCreate virtualmachine/test-vm Created DataVolume test-vm-dv 33s Normal SuccessfulCreate virtualmachine/test-vm Started the virtual machine by creating the new virtual machine instance test-vm 33s Normal SuccessfulCreate virtualmachineinstance/test-vm Created virtual machine pod virt-launcher-test-vm-bld82 29s Normal Created virtualmachineinstance/test-vm VirtualMachineInstance defined. 6s Warning Migrated virtualmachineinstance/test-vm EvictionStrategy is set but vmi is not migratable; cannot migrate VMI: PVC test-vm-dv is not shared, live migration requires that all PVCs must be shared (using ReadWriteMany access mode) 29s Normal Started virtualmachineinstance/test-vm VirtualMachineInstance started. 33s Normal Scheduled pod/virt-launcher-test-vm-bld82 Successfully assigned test-oadp-185/virt-launcher-test-vm-bld82 to ip-10-0-60-83.us-east-2.compute.internal 33s Normal SuccessfulMountVolume pod/virt-launcher-test-vm-bld82 MapVolume.MapPodDevice succeeded for volume "pvc-01e654c5-6a3a-48fe-839e-f88cc66ed88f" globalMapPath "/var/lib/kubelet/plugins/kubernetes.io/csi/volumeDevices/pvc-01e654c5-6a3a-48fe-839e-f88cc66ed88f/dev" 33s Normal SuccessfulMountVolume pod/virt-launcher-test-vm-bld82 MapVolume.MapPodDevice succeeded for volume "pvc-01e654c5-6a3a-48fe-839e-f88cc66ed88f" volumeMapPath "/var/lib/kubelet/pods/0944120a-8199-4b91-a34b-1d2a0a56e9eb/volumeDevices/kubernetes.io~csi" 33s Normal AddedInterface pod/virt-launcher-test-vm-bld82 Add eth0 [10.129.2.106/23] from ovn-kubernetes 33s Normal Pulled pod/virt-launcher-test-vm-bld82 Container image "registry.redhat.io/container-native-virtualization/virt-launcher-rhel9@sha256:3138ad3a4471ca69be37fbe50a96be4b89e120de0e2808067ca99ff576f16256" already present on machine 32s Normal Created pod/virt-launcher-test-vm-bld82 Created container: guest-console-log 32s Normal Started pod/virt-launcher-test-vm-bld82 Started container guest-console-log 32s Normal Pulled pod/virt-launcher-test-vm-bld82 Container image "registry.redhat.io/container-native-virtualization/virt-launcher-rhel9@sha256:3138ad3a4471ca69be37fbe50a96be4b89e120de0e2808067ca99ff576f16256" already present on machine 32s Normal Created pod/virt-launcher-test-vm-bld82 Created container: compute 32s Normal Started pod/virt-launcher-test-vm-bld82 Started container compute [FAILED] in [It] - /alabama/cspi/test_common/backup_restore_app_case.go:52 @ 02/05/26 16:38:34.341 < Exit [It] [tc-id:OADP-185] [kubevirt] [Tier0] [vf:vm] Backing up started VM should succeed @ 02/05/26 16:38:34.341 (1m19.809s) > Enter [JustAfterEach] TOP-LEVEL @ 02/05/26 16:38:34.341 2026/02/05 16:38:34 Using Must-gather image: registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 STEP: Get the failed spec name @ 02/05/26 16:38:34.341 2026/02/05 16:38:34 The failed spec name is: CSI: Backup/Restore Openshift Virtualization Workloads [tc-id:OADP-185] [kubevirt] [Tier0] [vf:vm] Backing up started VM should succeed STEP: Create a folder for all must-gather files if it doesn't exists already @ 02/05/26 16:38:34.341 STEP: Create a folder for the failed spec if it doesn't exists already @ 02/05/26 16:38:34.341 STEP: Run must-gather because the spec failed @ 02/05/26 16:38:34.341 2026/02/05 16:38:34 Log the present working directory path:- /alabama/cspi/e2e/kubevirt-plugin 2026/02/05 16:38:34 [adm must-gather --dest-dir /alabama/cspi/e2e/kubevirt-plugin/logs/It_CSI_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-185_kubevirt_Tier0_vf_vm_Backing_up_started_VM_should_succeed --image registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3] 2026/02/05 16:38:45 Log all the files present in /alabama/cspi/e2e/kubevirt-plugin/logs directory 2026/02/05 16:38:45 It_CSI_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-185_kubevirt_Tier0_vf_vm_Backing_up_started_VM_should_succeed 2026/02/05 16:38:45 It_Native_CSI_Data_Mover_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-401_kubevirt_Tier1_Started_VM_should_over_ceph_filesytem_mode STEP: Find must-gather folder and rename it to a shorter more readable name @ 02/05/26 16:38:45.133 The folder logs/It_CSI_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-185_kubevirt_Tier0_vf_vm_Backing_up_started_VM_should_succeed/must-gather already exists, skipping renaming the folder < Exit [JustAfterEach] TOP-LEVEL @ 02/05/26 16:38:45.133 (10.792s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:38:45.133 2026/02/05 16:38:45 Cleaning app 2026/02/05 16:38:45 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11  30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11  40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18  49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}"  ^ column 18  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Cleanup resources] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/cleanup.yml for localhost [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-185] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=22  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026/02/05 16:39:18 2026-02-05 16:38:46,944 p=26232 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:38:46,945 p=26232 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:38:47,303 p=26232 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:38:47,304 p=26232 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:38:47,666 p=26232 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:38:47,666 p=26232 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:38:48,022 p=26232 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:38:48,022 p=26232 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:38:48,044 p=26232 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:38:48,045 p=26232 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:38:48,045 p=26232 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:38:48,071 p=26232 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:38:48,071 p=26232 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:38:48,090 p=26232 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:38:48,090 p=26232 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:38:48,669 p=26232 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:38:48,670 p=26232 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:38:48,670 p=26232 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:38:48,670 p=26232 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:38:48,709 p=26232 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:38:48,709 p=26232 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:38:48,739 p=26232 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:38:48,739 p=26232 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:38:48,744 p=26232 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:38:49,568 p=26232 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:38:49,569 p=26232 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:38:49,909 p=26232 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** 2026-02-05 16:38:49,909 p=26232 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:38:50,266 p=26232 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** 2026-02-05 16:38:50,267 p=26232 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:38:50,836 p=26232 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** 2026-02-05 16:38:50,837 p=26232 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11 30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:38:50,838 p=26232 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:38:51,322 p=26232 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** 2026-02-05 16:38:51,322 p=26232 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11 40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:38:51,323 p=26232 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:38:51,355 p=26232 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** 2026-02-05 16:38:51,355 p=26232 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18 49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}" ^ column 18 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:38:51,355 p=26232 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:38:51,384 p=26232 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Cleanup resources] *** 2026-02-05 16:38:51,395 p=26232 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/cleanup.yml for localhost 2026-02-05 16:39:17,941 p=26232 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-185] *** 2026-02-05 16:39:17,942 p=26232 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:39:17,942 p=26232 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:39:17,943 p=26232 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:39:17,943 p=26232 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:39:17,943 p=26232 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:39:18,004 p=26232 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:39:18,004 p=26232 u=1001930000 n=ansible INFO| localhost : ok=22 changed=5 unreachable=0 failed=0 skipped=6 rescued=0 ignored=0 < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:39:18.061 (32.927s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:39:18.061 2026/02/05 16:39:18 Cleaning setup resources for the backup 2026/02/05 16:39:18 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 16:39:18 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2026/02/05 16:39:18 Deleting VolumeSnapshotClass 'example-snapclass' < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:39:18.096 (35ms) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:39:18.096 2026/02/05 16:39:18 Deleting DPA CR < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:39:18.11 (14ms) Attempt #2 Failed. Retrying ↺ @ 02/05/26 16:39:18.11 > Enter [BeforeEach] CSI: Backup/Restore Openshift Virtualization Workloads @ 02/05/26 16:39:18.11 < Exit [BeforeEach] CSI: Backup/Restore Openshift Virtualization Workloads @ 02/05/26 16:39:18.124 (14ms) > Enter [JustBeforeEach] TOP-LEVEL @ 02/05/26 16:39:18.125 < Exit [JustBeforeEach] TOP-LEVEL @ 02/05/26 16:39:18.125 (0s) > Enter [It] [tc-id:OADP-185] [kubevirt] [Tier0] [vf:vm] Backing up started VM should succeed @ 02/05/26 16:39:18.125 2026/02/05 16:39:18 Delete all downloadrequest No download requests are found STEP: Create DPA CR @ 02/05/26 16:39:18.138 2026/02/05 16:39:18 csi 2026/02/05 16:39:18 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "d74502eb-79f0-43a5-952c-1664d49d9e62", "resourceVersion": "82732", "generation": 1, "creationTimestamp": "2026-02-05T16:39:18Z", "managedFields": [ { "manager": "kubevirt-plugin.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T16:39:18Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "kubevirt" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false } }, "features": null, "logFormat": "text" }, "status": {} } Delete all the backups that remained in the phase InProgress Deleting backup CRs in progress Deletion of backup CRs in progress completed Delete all the restores that remained in the phase InProgress Deleting restore CRs in progress Deletion of restore CRs in progress completed STEP: Verify DPA CR setup @ 02/05/26 16:39:18.225 2026/02/05 16:39:18 Waiting for velero pod to be running 2026/02/05 16:39:18 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete' 2026/02/05 16:39:18 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "d74502eb-79f0-43a5-952c-1664d49d9e62", "resourceVersion": "82732", "generation": 1, "creationTimestamp": "2026-02-05T16:39:18Z", "managedFields": [ { "manager": "kubevirt-plugin.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T16:39:18Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "kubevirt" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false } }, "features": null, "logFormat": "text" }, "status": {} } 2026/02/05 16:39:23 DPA successfully reconciled STEP: Prepare backup resources, depending on the volumes backup type @ 02/05/26 16:39:23.248 2026/02/05 16:39:23 Snapclass 'example-snapclass' doesn't exist, creating 2026/02/05 16:39:23 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 16:39:23 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd STEP: Installing application for case ocp-kubevirt @ 02/05/26 16:39:23.479 2026/02/05 16:39:23 🔄 [Attempt 1/3] Executing operation: Deploy application ocp-kubevirt 2026/02/05 16:39:23 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11  30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11  40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18  49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}"  ^ column 18  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create resources] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml for localhost [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create namespace] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Deploy VM test-vm] *** changed: [localhost] FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (60 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (59 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (58 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (57 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (56 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (55 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:44:11  42 --command "echo '{{ text_content }}' > {{ file_path }}" 43 environment: 44 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  FAILED - RETRYING: [localhost]: Run echo command on the VM (60 retries left). FAILED - RETRYING: [localhost]: Run echo command on the VM (59 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Run echo command on the VM] *** changed: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:60:11  58 --command "cat {{ file_path }}" 59 environment: 60 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify file creation and content] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Display confirmation message] *** ok: [localhost] => {  "msg": "Text content written to '/home/fedora/test' on the VM 'test-vm' successfully." } PLAY RECAP ********************************************************************* localhost : ok=27  changed=8  unreachable=0 failed=0 skipped=7  rescued=0 ignored=0 2026/02/05 16:40:26 2026-02-05 16:39:25,218 p=26507 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:39:25,218 p=26507 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:39:25,531 p=26507 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:39:25,531 p=26507 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:39:25,848 p=26507 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:39:25,848 p=26507 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:39:26,160 p=26507 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:39:26,160 p=26507 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:39:26,177 p=26507 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:39:26,178 p=26507 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:39:26,178 p=26507 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:39:26,199 p=26507 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:39:26,199 p=26507 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:39:26,214 p=26507 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:39:26,214 p=26507 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:39:26,631 p=26507 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:39:26,631 p=26507 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:39:26,632 p=26507 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:39:26,632 p=26507 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:39:26,659 p=26507 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:39:26,659 p=26507 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:39:26,680 p=26507 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:39:26,680 p=26507 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:39:26,683 p=26507 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:39:27,297 p=26507 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:39:27,297 p=26507 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:39:27,557 p=26507 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** 2026-02-05 16:39:27,557 p=26507 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:39:27,828 p=26507 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** 2026-02-05 16:39:27,829 p=26507 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:39:28,213 p=26507 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** 2026-02-05 16:39:28,214 p=26507 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11 30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:39:28,214 p=26507 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:39:28,582 p=26507 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** 2026-02-05 16:39:28,582 p=26507 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11 40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:39:28,583 p=26507 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:39:28,608 p=26507 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** 2026-02-05 16:39:28,608 p=26507 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18 49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}" ^ column 18 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:39:28,608 p=26507 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:39:28,645 p=26507 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create resources] *** 2026-02-05 16:39:28,661 p=26507 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml for localhost 2026-02-05 16:39:29,789 p=26507 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create namespace] *** 2026-02-05 16:39:29,790 p=26507 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:39:29,790 p=26507 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:39:29,790 p=26507 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:39:29,791 p=26507 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:39:29,791 p=26507 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:39:30,823 p=26507 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Deploy VM test-vm] *** 2026-02-05 16:39:30,824 p=26507 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:39:31,896 p=26507 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (60 retries left). 2026-02-05 16:39:37,801 p=26507 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (59 retries left). 2026-02-05 16:39:43,733 p=26507 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (58 retries left). 2026-02-05 16:39:49,658 p=26507 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (57 retries left). 2026-02-05 16:39:55,578 p=26507 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (56 retries left). 2026-02-05 16:40:01,476 p=26507 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (55 retries left). 2026-02-05 16:40:07,381 p=26507 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** 2026-02-05 16:40:07,382 p=26507 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:40:10,848 p=26507 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Run echo command on the VM (60 retries left). 2026-02-05 16:40:19,295 p=26507 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Run echo command on the VM (59 retries left). 2026-02-05 16:40:25,641 p=26507 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Run echo command on the VM] *** 2026-02-05 16:40:25,641 p=26507 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:44:11 42 --command "echo '{{ text_content }}' > {{ file_path }}" 43 environment: 44 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:40:25,641 p=26507 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:40:26,180 p=26507 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify file creation and content] *** 2026-02-05 16:40:26,180 p=26507 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:60:11 58 --command "cat {{ file_path }}" 59 environment: 60 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:40:26,180 p=26507 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:40:26,197 p=26507 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Display confirmation message] *** 2026-02-05 16:40:26,197 p=26507 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Text content written to '/home/fedora/test' on the VM 'test-vm' successfully." } 2026-02-05 16:40:26,244 p=26507 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:40:26,244 p=26507 u=1001930000 n=ansible INFO| localhost : ok=27 changed=8 unreachable=0 failed=0 skipped=7 rescued=0 ignored=0 STEP: Verify Application deployment @ 02/05/26 16:40:26.302 2026/02/05 16:40:26 Using admin kubeconfig for with_validate operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11  30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11  40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18  49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}"  ^ column 18  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Validate migration] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml for localhost [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to have AgentConnected status True indicating the guest agent is running] *** [ERROR]: Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result.  Task failed. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:33:3  31 when: vm_running | bool 32 33 - name: Wait for VM to have AgentConnected status True indicating the guest agent is running  ^ column 3  <<< caused by >>>  Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10  41 verify_ssl: no 42 register: vm 43 until: vm.resources[0].status.conditions | selectattr('type', 'equalto', 'AgentConnected') | selectattr('status'...  ^ column 10  Broken conditionals can be temporarily allowed with the `ALLOW_BROKEN_CONDITIONALS` configuration option.  fatal: [localhost]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result."} PLAY RECAP ********************************************************************* localhost : ok=22  changed=4  unreachable=0 failed=1  skipped=6  rescued=0 ignored=0 2026/02/05 16:40:33 2026-02-05 16:40:28,034 p=27046 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:40:28,034 p=27046 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:40:28,346 p=27046 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:40:28,347 p=27046 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:40:28,673 p=27046 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:40:28,673 p=27046 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:40:28,997 p=27046 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:40:28,997 p=27046 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:40:29,015 p=27046 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:40:29,016 p=27046 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:40:29,016 p=27046 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:40:29,037 p=27046 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:40:29,037 p=27046 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:40:29,053 p=27046 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:40:29,053 p=27046 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:40:29,495 p=27046 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:40:29,495 p=27046 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:40:29,495 p=27046 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:40:29,495 p=27046 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:40:29,523 p=27046 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:40:29,523 p=27046 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:40:29,545 p=27046 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:40:29,545 p=27046 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:40:29,548 p=27046 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:40:30,151 p=27046 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:40:30,151 p=27046 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:40:30,415 p=27046 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** 2026-02-05 16:40:30,415 p=27046 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:40:30,676 p=27046 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** 2026-02-05 16:40:30,676 p=27046 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:40:31,049 p=27046 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** 2026-02-05 16:40:31,049 p=27046 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11 30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:40:31,049 p=27046 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:40:31,419 p=27046 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** 2026-02-05 16:40:31,420 p=27046 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11 40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:40:31,420 p=27046 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:40:31,445 p=27046 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** 2026-02-05 16:40:31,445 p=27046 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18 49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}" ^ column 18 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:40:31,445 p=27046 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:40:31,500 p=27046 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Validate migration] *** 2026-02-05 16:40:31,513 p=27046 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml for localhost 2026-02-05 16:40:32,607 p=27046 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** 2026-02-05 16:40:32,607 p=27046 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:40:32,607 p=27046 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:40:32,608 p=27046 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:40:32,608 p=27046 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:40:32,608 p=27046 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:40:33,612 p=27046 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to have AgentConnected status True indicating the guest agent is running] *** 2026-02-05 16:40:33,613 p=27046 u=1001930000 n=ansible ERROR| [ERROR]: Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result. Task failed. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:33:3 31 when: vm_running | bool 32 33 - name: Wait for VM to have AgentConnected status True indicating the guest agent is running ^ column 3 <<< caused by >>> Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10 41 verify_ssl: no 42 register: vm 43 until: vm.resources[0].status.conditions | selectattr('type', 'equalto', 'AgentConnected') | selectattr('status'... ^ column 10 Broken conditionals can be temporarily allowed with the `ALLOW_BROKEN_CONDITIONALS` configuration option. 2026-02-05 16:40:33,613 p=27046 u=1001930000 n=ansible INFO| fatal: [localhost]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:43:10'. Conditionals must have a boolean result."} 2026-02-05 16:40:33,614 p=27046 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:40:33,614 p=27046 u=1001930000 n=ansible INFO| localhost : ok=22 changed=4 unreachable=0 failed=1 skipped=6 rescued=0 ignored=0 Run the command: oc get event -n test-oadp-185 2026/02/05 16:40:33 LAST SEEN TYPE REASON OBJECT MESSAGE 62s Warning FailedScheduling pod/importer-prime-30f337e5-06cb-4f48-9d96-8671b671332c 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 55s Warning FailedScheduling pod/importer-prime-30f337e5-06cb-4f48-9d96-8671b671332c 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 55s Normal Scheduled pod/importer-prime-30f337e5-06cb-4f48-9d96-8671b671332c Successfully assigned test-oadp-185/importer-prime-30f337e5-06cb-4f48-9d96-8671b671332c to ip-10-0-60-83.us-east-2.compute.internal 54s Normal SuccessfulAttachVolume pod/importer-prime-30f337e5-06cb-4f48-9d96-8671b671332c AttachVolume.Attach succeeded for volume "pvc-b6d5d70e-de95-49ab-838e-6e191ac1f4e5" 50s Normal SuccessfulMountVolume pod/importer-prime-30f337e5-06cb-4f48-9d96-8671b671332c MapVolume.MapPodDevice succeeded for volume "pvc-b6d5d70e-de95-49ab-838e-6e191ac1f4e5" globalMapPath "/var/lib/kubelet/plugins/kubernetes.io/csi/volumeDevices/pvc-b6d5d70e-de95-49ab-838e-6e191ac1f4e5/dev" 50s Normal SuccessfulMountVolume pod/importer-prime-30f337e5-06cb-4f48-9d96-8671b671332c MapVolume.MapPodDevice succeeded for volume "pvc-b6d5d70e-de95-49ab-838e-6e191ac1f4e5" volumeMapPath "/var/lib/kubelet/pods/f91d7309-0d03-4b41-9c91-a3d4fff8d123/volumeDevices/kubernetes.io~csi" 49s Normal AddedInterface pod/importer-prime-30f337e5-06cb-4f48-9d96-8671b671332c Add eth0 [10.129.2.109/23] from ovn-kubernetes 49s Normal Pulled pod/importer-prime-30f337e5-06cb-4f48-9d96-8671b671332c Container image "registry.redhat.io/container-native-virtualization/virt-cdi-importer-rhel9@sha256:84d3534ff8027475d41f6dee3c827640905b98dc5251c6a31abad5c7d4cdb2dc" already present on machine 49s Normal Created pod/importer-prime-30f337e5-06cb-4f48-9d96-8671b671332c Created container: init 49s Normal Started pod/importer-prime-30f337e5-06cb-4f48-9d96-8671b671332c Started container init 49s Normal Pulled pod/importer-prime-30f337e5-06cb-4f48-9d96-8671b671332c Container image "registry.redhat.io/container-native-virtualization/virt-cdi-importer-rhel9@sha256:84d3534ff8027475d41f6dee3c827640905b98dc5251c6a31abad5c7d4cdb2dc" already present on machine 49s Normal Created pod/importer-prime-30f337e5-06cb-4f48-9d96-8671b671332c Created container: importer 49s Normal Started pod/importer-prime-30f337e5-06cb-4f48-9d96-8671b671332c Started container importer 49s Normal Pulled pod/importer-prime-30f337e5-06cb-4f48-9d96-8671b671332c Container image "quay.io/kubevirt/fedora-with-test-tooling-container-disk" already present on machine 49s Normal Created pod/importer-prime-30f337e5-06cb-4f48-9d96-8671b671332c Created container: server 49s Normal Started pod/importer-prime-30f337e5-06cb-4f48-9d96-8671b671332c Started container server 63s Warning ProvisioningFailed persistentvolumeclaim/prime-30f337e5-06cb-4f48-9d96-8671b671332c Error saving claim: Operation cannot be fulfilled on persistentvolumeclaims "prime-30f337e5-06cb-4f48-9d96-8671b671332c": the object has been modified; please apply your changes to the latest version and try again 55s Normal ExternalProvisioning persistentvolumeclaim/prime-30f337e5-06cb-4f48-9d96-8671b671332c Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 55s Normal Provisioning persistentvolumeclaim/prime-30f337e5-06cb-4f48-9d96-8671b671332c External provisioner is provisioning volume for claim "test-oadp-185/prime-30f337e5-06cb-4f48-9d96-8671b671332c" 55s Normal ProvisioningSucceeded persistentvolumeclaim/prime-30f337e5-06cb-4f48-9d96-8671b671332c Successfully provisioned volume pvc-b6d5d70e-de95-49ab-838e-6e191ac1f4e5 30s Normal ImportSucceeded persistentvolumeclaim/prime-30f337e5-06cb-4f48-9d96-8671b671332c Import Successful 25s Warning ClaimMisbound persistentvolumeclaim/prime-30f337e5-06cb-4f48-9d96-8671b671332c Two claims are bound to the same volume, this one is bound incorrectly 22s Warning UnrecognizedDataSourceKind persistentvolumeclaim/test-vm-dv The datasource for this PVC does not match any registered VolumePopulator 63s Normal CreatedPVCPrimeSuccessfully persistentvolumeclaim/test-vm-dv PVC Prime created successfully 63s Normal NotFound datavolume/test-vm-dv No PVC found 63s Normal Pending datavolume/test-vm-dv PVC test-vm-dv Pending 63s Warning ProvisioningFailed persistentvolumeclaim/test-vm-dv Error saving claim: Operation cannot be fulfilled on persistentvolumeclaims "test-vm-dv": the object has been modified; please apply your changes to the latest version and try again 30s Normal Provisioning persistentvolumeclaim/test-vm-dv External provisioner is provisioning volume for claim "test-oadp-185/test-vm-dv" 30s Normal Provisioning persistentvolumeclaim/test-vm-dv Assuming an external populator will provision the volume 30s Normal ExternalProvisioning persistentvolumeclaim/test-vm-dv Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 55s Normal ImportScheduled datavolume/test-vm-dv Import into test-vm-dv scheduled 48s Normal ImportInProgress datavolume/test-vm-dv Import into test-vm-dv in progress 33s Warning Completed datavolume/test-vm-dv Import Complete 25s Normal importSucceeded persistentvolumeclaim/test-vm-dv Successfully imported into test-vm-dv 30s Normal ImportSucceeded datavolume/test-vm-dv Successfully imported into PVC test-vm-dv 30s Normal Bound datavolume/test-vm-dv PVC test-vm-dv Bound 63s Normal SuccessfulDataVolumeCreate virtualmachine/test-vm Created DataVolume test-vm-dv 30s Normal SuccessfulCreate virtualmachine/test-vm Started the virtual machine by creating the new virtual machine instance test-vm 30s Normal SuccessfulCreate virtualmachineinstance/test-vm Created virtual machine pod virt-launcher-test-vm-6k6ln 26s Normal Created virtualmachineinstance/test-vm VirtualMachineInstance defined. 3s Warning Migrated virtualmachineinstance/test-vm EvictionStrategy is set but vmi is not migratable; cannot migrate VMI: PVC test-vm-dv is not shared, live migration requires that all PVCs must be shared (using ReadWriteMany access mode) 26s Normal Started virtualmachineinstance/test-vm VirtualMachineInstance started. 30s Normal Scheduled pod/virt-launcher-test-vm-6k6ln Successfully assigned test-oadp-185/virt-launcher-test-vm-6k6ln to ip-10-0-60-83.us-east-2.compute.internal 30s Normal SuccessfulMountVolume pod/virt-launcher-test-vm-6k6ln MapVolume.MapPodDevice succeeded for volume "pvc-b6d5d70e-de95-49ab-838e-6e191ac1f4e5" globalMapPath "/var/lib/kubelet/plugins/kubernetes.io/csi/volumeDevices/pvc-b6d5d70e-de95-49ab-838e-6e191ac1f4e5/dev" 30s Normal SuccessfulMountVolume pod/virt-launcher-test-vm-6k6ln MapVolume.MapPodDevice succeeded for volume "pvc-b6d5d70e-de95-49ab-838e-6e191ac1f4e5" volumeMapPath "/var/lib/kubelet/pods/500a4e84-1cd6-47dd-84f4-a81fc61a29aa/volumeDevices/kubernetes.io~csi" 30s Normal AddedInterface pod/virt-launcher-test-vm-6k6ln Add eth0 [10.129.2.111/23] from ovn-kubernetes 30s Normal Pulled pod/virt-launcher-test-vm-6k6ln Container image "registry.redhat.io/container-native-virtualization/virt-launcher-rhel9@sha256:3138ad3a4471ca69be37fbe50a96be4b89e120de0e2808067ca99ff576f16256" already present on machine 29s Normal Created pod/virt-launcher-test-vm-6k6ln Created container: guest-console-log 29s Normal Started pod/virt-launcher-test-vm-6k6ln Started container guest-console-log 29s Normal Pulled pod/virt-launcher-test-vm-6k6ln Container image "registry.redhat.io/container-native-virtualization/virt-launcher-rhel9@sha256:3138ad3a4471ca69be37fbe50a96be4b89e120de0e2808067ca99ff576f16256" already present on machine 29s Normal Created pod/virt-launcher-test-vm-6k6ln Created container: compute 29s Normal Started pod/virt-launcher-test-vm-6k6ln Started container compute [FAILED] in [It] - /alabama/cspi/test_common/backup_restore_app_case.go:52 @ 02/05/26 16:40:33.811 < Exit [It] [tc-id:OADP-185] [kubevirt] [Tier0] [vf:vm] Backing up started VM should succeed @ 02/05/26 16:40:33.811 (1m15.687s) > Enter [JustAfterEach] TOP-LEVEL @ 02/05/26 16:40:33.811 2026/02/05 16:40:33 Using Must-gather image: registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 STEP: Get the failed spec name @ 02/05/26 16:40:33.812 2026/02/05 16:40:33 The failed spec name is: CSI: Backup/Restore Openshift Virtualization Workloads [tc-id:OADP-185] [kubevirt] [Tier0] [vf:vm] Backing up started VM should succeed STEP: Create a folder for all must-gather files if it doesn't exists already @ 02/05/26 16:40:33.812 STEP: Create a folder for the failed spec if it doesn't exists already @ 02/05/26 16:40:33.812 STEP: Run must-gather because the spec failed @ 02/05/26 16:40:33.812 2026/02/05 16:40:33 Log the present working directory path:- /alabama/cspi/e2e/kubevirt-plugin 2026/02/05 16:40:33 [adm must-gather --dest-dir /alabama/cspi/e2e/kubevirt-plugin/logs/It_CSI_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-185_kubevirt_Tier0_vf_vm_Backing_up_started_VM_should_succeed --image registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3] 2026/02/05 16:40:44 Log all the files present in /alabama/cspi/e2e/kubevirt-plugin/logs directory 2026/02/05 16:40:44 It_CSI_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-185_kubevirt_Tier0_vf_vm_Backing_up_started_VM_should_succeed 2026/02/05 16:40:44 It_Native_CSI_Data_Mover_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-401_kubevirt_Tier1_Started_VM_should_over_ceph_filesytem_mode STEP: Find must-gather folder and rename it to a shorter more readable name @ 02/05/26 16:40:44.622 The folder logs/It_CSI_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-185_kubevirt_Tier0_vf_vm_Backing_up_started_VM_should_succeed/must-gather already exists, skipping renaming the folder < Exit [JustAfterEach] TOP-LEVEL @ 02/05/26 16:40:44.622 (10.811s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:40:44.622 2026/02/05 16:40:44 Cleaning app 2026/02/05 16:40:44 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11  30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11  40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18  49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}"  ^ column 18  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Cleanup resources] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/cleanup.yml for localhost [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-185] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=22  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026/02/05 16:41:16 2026-02-05 16:40:46,285 p=27400 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:40:46,285 p=27400 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:40:46,611 p=27400 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:40:46,611 p=27400 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:40:46,926 p=27400 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:40:46,926 p=27400 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:40:47,241 p=27400 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:40:47,241 p=27400 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:40:47,260 p=27400 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:40:47,260 p=27400 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:40:47,260 p=27400 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:40:47,280 p=27400 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:40:47,280 p=27400 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:40:47,295 p=27400 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:40:47,296 p=27400 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:40:47,727 p=27400 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:40:47,728 p=27400 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:40:47,728 p=27400 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:40:47,728 p=27400 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:40:47,755 p=27400 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:40:47,755 p=27400 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:40:47,776 p=27400 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:40:47,776 p=27400 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:40:47,779 p=27400 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:40:48,401 p=27400 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:40:48,401 p=27400 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:40:48,660 p=27400 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** 2026-02-05 16:40:48,661 p=27400 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:40:48,924 p=27400 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** 2026-02-05 16:40:48,924 p=27400 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:40:49,311 p=27400 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** 2026-02-05 16:40:49,312 p=27400 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11 30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:40:49,312 p=27400 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:40:49,664 p=27400 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** 2026-02-05 16:40:49,665 p=27400 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11 40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:40:49,665 p=27400 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:40:49,689 p=27400 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** 2026-02-05 16:40:49,690 p=27400 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18 49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}" ^ column 18 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:40:49,690 p=27400 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:40:49,712 p=27400 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Cleanup resources] *** 2026-02-05 16:40:49,722 p=27400 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/cleanup.yml for localhost 2026-02-05 16:41:15,950 p=27400 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-185] *** 2026-02-05 16:41:15,950 p=27400 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:41:15,950 p=27400 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:41:15,951 p=27400 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:41:15,951 p=27400 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:41:15,951 p=27400 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:41:16,014 p=27400 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:41:16,014 p=27400 u=1001930000 n=ansible INFO| localhost : ok=22 changed=5 unreachable=0 failed=0 skipped=6 rescued=0 ignored=0 < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:41:16.075 (31.452s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:41:16.075 2026/02/05 16:41:16 Cleaning setup resources for the backup 2026/02/05 16:41:16 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 16:41:16 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2026/02/05 16:41:16 Deleting VolumeSnapshotClass 'example-snapclass' < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:41:16.102 (28ms) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:41:16.102 2026/02/05 16:41:16 Deleting DPA CR < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:41:16.111 (9ms) • [FAILED] [356.478 seconds] CSI: Backup/Restore Openshift Virtualization Workloads  [It] [tc-id:OADP-185] [kubevirt] [Tier0] [vf:vm] Backing up started VM should succeed /alabama/cspi/e2e/kubevirt-plugin/backup_restore_csi.go:34 [FAILED] Unexpected error: <*errors.Error | 0xc00014e500>: Error during command execution: ansible-playbook error: one or more host failed Command executed: /usr/local/bin/ansible-playbook --extra-vars {"admin_kubeconfig":"/home/jenkins/.kube/config","namespace":"test-oadp-185","non_admin_user":false,"use_role":"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt","user_kubeconfig":"/home/jenkins/.kube/config","vm_running":true,"with_validate":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml exit status 2 { context: "(DefaultExecute::Execute)", message: "Error during command execution: ansible-playbook error: one or more host failed\n\nCommand executed: /usr/local/bin/ansible-playbook --extra-vars {\"admin_kubeconfig\":\"/home/jenkins/.kube/config\",\"namespace\":\"test-oadp-185\",\"non_admin_user\":false,\"use_role\":\"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt\",\"user_kubeconfig\":\"/home/jenkins/.kube/config\",\"vm_running\":true,\"with_validate\":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml\n\nexit status 2", wrappedErrors: nil, } occurred In [It] at: /alabama/cspi/test_common/backup_restore_app_case.go:52 @ 02/05/26 16:40:33.811 There were additional failures detected. To view them in detail run ginkgo -vv ------------------------------ CSI: Backup/Restore Openshift Virtualization Workloads  [tc-id:OADP-186] [kubevirt] [Tier0] [vf:vm] Stopped VM should be restored /alabama/cspi/e2e/kubevirt-plugin/backup_restore_csi.go:51 > Enter [BeforeEach] CSI: Backup/Restore Openshift Virtualization Workloads @ 02/05/26 16:41:16.112 < Exit [BeforeEach] CSI: Backup/Restore Openshift Virtualization Workloads @ 02/05/26 16:41:16.131 (19ms) > Enter [JustBeforeEach] TOP-LEVEL @ 02/05/26 16:41:16.131 < Exit [JustBeforeEach] TOP-LEVEL @ 02/05/26 16:41:16.131 (0s) > Enter [It] [tc-id:OADP-186] [kubevirt] [Tier0] [vf:vm] Stopped VM should be restored @ 02/05/26 16:41:16.131 2026/02/05 16:41:16 Delete all downloadrequest No download requests are found STEP: Create DPA CR @ 02/05/26 16:41:16.135 2026/02/05 16:41:16 csi 2026/02/05 16:41:16 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "d4c4cbcb-ef05-4832-8ba7-8c7d6fc38376", "resourceVersion": "84957", "generation": 1, "creationTimestamp": "2026-02-05T16:41:16Z", "managedFields": [ { "manager": "kubevirt-plugin.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T16:41:16Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "kubevirt" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false } }, "features": null, "logFormat": "text" }, "status": {} } Delete all the backups that remained in the phase InProgress Deleting backup CRs in progress Deletion of backup CRs in progress completed Delete all the restores that remained in the phase InProgress Deleting restore CRs in progress Deletion of restore CRs in progress completed STEP: Verify DPA CR setup @ 02/05/26 16:41:16.231 2026/02/05 16:41:16 Waiting for velero pod to be running 2026/02/05 16:41:16 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete' 2026/02/05 16:41:16 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "d4c4cbcb-ef05-4832-8ba7-8c7d6fc38376", "resourceVersion": "84957", "generation": 1, "creationTimestamp": "2026-02-05T16:41:16Z", "managedFields": [ { "manager": "kubevirt-plugin.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T16:41:16Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "kubevirt" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false } }, "features": null, "logFormat": "text" }, "status": {} } 2026/02/05 16:41:21 DPA successfully reconciled STEP: Prepare backup resources, depending on the volumes backup type @ 02/05/26 16:41:21.26 Run the command: oc get ns openshift-storage &> /dev/null && echo true || echo false 2026/02/05 16:41:21 The 'openshift-storage' namespace exists 2026/02/05 16:41:21 Checking default storage class count 2026/02/05 16:41:21 Using the CSI driver: openshift-storage.rbd.csi.ceph.com 2026/02/05 16:41:21 Snapclass 'example-snapclass' doesn't exist, creating 2026/02/05 16:41:21 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 16:41:21 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd STEP: Installing application for case ocp-kubevirt @ 02/05/26 16:41:21.569 2026/02/05 16:41:21 🔄 [Attempt 1/3] Executing operation: Deploy application ocp-kubevirt 2026/02/05 16:41:21 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11  30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11  40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18  49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}"  ^ column 18  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create resources] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml for localhost [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create namespace] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Deploy VM test-vm] *** changed: [localhost] FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (60 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (59 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (58 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (57 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (56 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (55 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (54 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (53 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (52 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:44:11  42 --command "echo '{{ text_content }}' > {{ file_path }}" 43 environment: 44 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  FAILED - RETRYING: [localhost]: Run echo command on the VM (60 retries left). FAILED - RETRYING: [localhost]: Run echo command on the VM (59 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Run echo command on the VM] *** changed: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:60:11  58 --command "cat {{ file_path }}" 59 environment: 60 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify file creation and content] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Display confirmation message] *** ok: [localhost] => {  "msg": "Text content written to '/home/fedora/test' on the VM 'test-vm' successfully." } TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Shutdown the VM if required] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM status to become 'Stopped'] *** ok: [localhost] PLAY RECAP ********************************************************************* localhost : ok=29  changed=9  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026/02/05 16:42:44 2026-02-05 16:41:23,291 p=27693 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:41:23,291 p=27693 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:41:23,601 p=27693 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:41:23,601 p=27693 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:41:23,931 p=27693 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:41:23,931 p=27693 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:41:24,270 p=27693 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:41:24,270 p=27693 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:41:24,288 p=27693 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:41:24,288 p=27693 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:41:24,288 p=27693 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:41:24,307 p=27693 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:41:24,308 p=27693 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:41:24,322 p=27693 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:41:24,322 p=27693 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:41:24,741 p=27693 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:41:24,742 p=27693 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:41:24,742 p=27693 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:41:24,742 p=27693 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:41:24,770 p=27693 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:41:24,771 p=27693 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:41:24,791 p=27693 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:41:24,792 p=27693 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:41:24,794 p=27693 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:41:25,511 p=27693 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:41:25,511 p=27693 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:41:25,768 p=27693 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** 2026-02-05 16:41:25,768 p=27693 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:41:26,018 p=27693 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** 2026-02-05 16:41:26,018 p=27693 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:41:26,479 p=27693 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** 2026-02-05 16:41:26,480 p=27693 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11 30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:41:26,480 p=27693 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:41:26,839 p=27693 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** 2026-02-05 16:41:26,840 p=27693 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11 40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:41:26,840 p=27693 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:41:26,865 p=27693 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** 2026-02-05 16:41:26,866 p=27693 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18 49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}" ^ column 18 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:41:26,866 p=27693 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:41:26,904 p=27693 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create resources] *** 2026-02-05 16:41:26,919 p=27693 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml for localhost 2026-02-05 16:41:28,036 p=27693 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create namespace] *** 2026-02-05 16:41:28,037 p=27693 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:41:28,037 p=27693 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:41:28,037 p=27693 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:41:28,037 p=27693 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:41:28,037 p=27693 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:41:29,055 p=27693 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Deploy VM test-vm] *** 2026-02-05 16:41:29,055 p=27693 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:41:30,143 p=27693 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (60 retries left). 2026-02-05 16:41:36,035 p=27693 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (59 retries left). 2026-02-05 16:41:41,977 p=27693 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (58 retries left). 2026-02-05 16:41:47,867 p=27693 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (57 retries left). 2026-02-05 16:41:53,786 p=27693 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (56 retries left). 2026-02-05 16:41:59,711 p=27693 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (55 retries left). 2026-02-05 16:42:05,664 p=27693 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (54 retries left). 2026-02-05 16:42:11,574 p=27693 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (53 retries left). 2026-02-05 16:42:17,479 p=27693 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (52 retries left). 2026-02-05 16:42:23,403 p=27693 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** 2026-02-05 16:42:23,404 p=27693 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:42:26,840 p=27693 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Run echo command on the VM (60 retries left). 2026-02-05 16:42:35,287 p=27693 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Run echo command on the VM (59 retries left). 2026-02-05 16:42:41,583 p=27693 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Run echo command on the VM] *** 2026-02-05 16:42:41,584 p=27693 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:44:11 42 --command "echo '{{ text_content }}' > {{ file_path }}" 43 environment: 44 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:42:41,584 p=27693 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:42:42,102 p=27693 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify file creation and content] *** 2026-02-05 16:42:42,102 p=27693 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:60:11 58 --command "cat {{ file_path }}" 59 environment: 60 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:42:42,103 p=27693 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:42:42,119 p=27693 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Display confirmation message] *** 2026-02-05 16:42:42,120 p=27693 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Text content written to '/home/fedora/test' on the VM 'test-vm' successfully." } 2026-02-05 16:42:43,116 p=27693 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Shutdown the VM if required] *** 2026-02-05 16:42:43,117 p=27693 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:42:44,049 p=27693 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM status to become 'Stopped'] *** 2026-02-05 16:42:44,050 p=27693 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:42:44,072 p=27693 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:42:44,073 p=27693 u=1001930000 n=ansible INFO| localhost : ok=29 changed=9 unreachable=0 failed=0 skipped=5 rescued=0 ignored=0 STEP: Verify Application deployment @ 02/05/26 16:42:44.139 2026/02/05 16:42:44 Using admin kubeconfig for with_validate operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11  30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11  40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18  49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}"  ^ column 18  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Validate migration] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml for localhost TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify VM is not in running state] *** [ERROR]: Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:11:10'. Conditionals must have a boolean result.  Task failed. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:1:3  1 - name: Verify VM is not in running state  ^ column 3  <<< caused by >>>  Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:11:10'. Conditionals must have a boolean result. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:11:10   9 verify_ssl: no 10 register: vm 11 until: vm.resources[0].status.conditions | selectattr('type', 'equalto', 'Ready') | selectattr('status', 'equalt...  ^ column 10  Broken conditionals can be temporarily allowed with the `ALLOW_BROKEN_CONDITIONALS` configuration option.  fatal: [localhost]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:11:10'. Conditionals must have a boolean result."} PLAY RECAP ********************************************************************* localhost : ok=21  changed=4  unreachable=0 failed=1  skipped=5  rescued=0 ignored=0 2026/02/05 16:42:50 2026-02-05 16:42:45,828 p=28298 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:42:45,828 p=28298 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:42:46,144 p=28298 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:42:46,144 p=28298 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:42:46,453 p=28298 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:42:46,453 p=28298 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:42:46,768 p=28298 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:42:46,768 p=28298 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:42:46,786 p=28298 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:42:46,786 p=28298 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:42:46,786 p=28298 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:42:46,806 p=28298 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:42:46,807 p=28298 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:42:46,821 p=28298 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:42:46,822 p=28298 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:42:47,263 p=28298 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:42:47,264 p=28298 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:42:47,264 p=28298 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:42:47,265 p=28298 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:42:47,294 p=28298 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:42:47,294 p=28298 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:42:47,315 p=28298 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:42:47,315 p=28298 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:42:47,318 p=28298 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:42:47,920 p=28298 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:42:47,921 p=28298 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:42:48,167 p=28298 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** 2026-02-05 16:42:48,167 p=28298 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:42:48,418 p=28298 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** 2026-02-05 16:42:48,418 p=28298 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:42:48,786 p=28298 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** 2026-02-05 16:42:48,786 p=28298 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11 30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:42:48,786 p=28298 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:42:49,138 p=28298 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** 2026-02-05 16:42:49,139 p=28298 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11 40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:42:49,139 p=28298 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:42:49,163 p=28298 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** 2026-02-05 16:42:49,163 p=28298 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18 49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}" ^ column 18 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:42:49,163 p=28298 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:42:49,214 p=28298 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Validate migration] *** 2026-02-05 16:42:49,227 p=28298 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml for localhost 2026-02-05 16:42:50,316 p=28298 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify VM is not in running state] *** 2026-02-05 16:42:50,317 p=28298 u=1001930000 n=ansible ERROR| [ERROR]: Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:11:10'. Conditionals must have a boolean result. Task failed. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:1:3 1 - name: Verify VM is not in running state ^ column 3 <<< caused by >>> Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:11:10'. Conditionals must have a boolean result. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:11:10 9 verify_ssl: no 10 register: vm 11 until: vm.resources[0].status.conditions | selectattr('type', 'equalto', 'Ready') | selectattr('status', 'equalt... ^ column 10 Broken conditionals can be temporarily allowed with the `ALLOW_BROKEN_CONDITIONALS` configuration option. 2026-02-05 16:42:50,317 p=28298 u=1001930000 n=ansible INFO| fatal: [localhost]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:11:10'. Conditionals must have a boolean result."} 2026-02-05 16:42:50,318 p=28298 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:42:50,318 p=28298 u=1001930000 n=ansible INFO| localhost : ok=21 changed=4 unreachable=0 failed=1 skipped=5 rescued=0 ignored=0 Run the command: oc get event -n test-oadp-186 2026/02/05 16:42:50 LAST SEEN TYPE REASON OBJECT MESSAGE 81s Warning FailedScheduling pod/importer-prime-f8306d83-5a9c-4559-837b-af37c4942e4e 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 81s Warning FailedScheduling pod/importer-prime-f8306d83-5a9c-4559-837b-af37c4942e4e 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 71s Normal Scheduled pod/importer-prime-f8306d83-5a9c-4559-837b-af37c4942e4e Successfully assigned test-oadp-186/importer-prime-f8306d83-5a9c-4559-837b-af37c4942e4e to ip-10-0-60-83.us-east-2.compute.internal 71s Normal SuccessfulAttachVolume pod/importer-prime-f8306d83-5a9c-4559-837b-af37c4942e4e AttachVolume.Attach succeeded for volume "pvc-696385ea-6b12-4010-b0c7-d8649db9b0ab" 64s Normal SuccessfulMountVolume pod/importer-prime-f8306d83-5a9c-4559-837b-af37c4942e4e MapVolume.MapPodDevice succeeded for volume "pvc-696385ea-6b12-4010-b0c7-d8649db9b0ab" globalMapPath "/var/lib/kubelet/plugins/kubernetes.io/csi/volumeDevices/pvc-696385ea-6b12-4010-b0c7-d8649db9b0ab/dev" 64s Normal SuccessfulMountVolume pod/importer-prime-f8306d83-5a9c-4559-837b-af37c4942e4e MapVolume.MapPodDevice succeeded for volume "pvc-696385ea-6b12-4010-b0c7-d8649db9b0ab" volumeMapPath "/var/lib/kubelet/pods/a1c6f94b-5d4e-4884-9cf3-198acb120b23/volumeDevices/kubernetes.io~csi" 64s Normal AddedInterface pod/importer-prime-f8306d83-5a9c-4559-837b-af37c4942e4e Add eth0 [10.129.2.114/23] from ovn-kubernetes 64s Normal Pulled pod/importer-prime-f8306d83-5a9c-4559-837b-af37c4942e4e Container image "registry.redhat.io/container-native-virtualization/virt-cdi-importer-rhel9@sha256:84d3534ff8027475d41f6dee3c827640905b98dc5251c6a31abad5c7d4cdb2dc" already present on machine 64s Normal Created pod/importer-prime-f8306d83-5a9c-4559-837b-af37c4942e4e Created container: init 64s Normal Started pod/importer-prime-f8306d83-5a9c-4559-837b-af37c4942e4e Started container init 63s Normal Pulled pod/importer-prime-f8306d83-5a9c-4559-837b-af37c4942e4e Container image "registry.redhat.io/container-native-virtualization/virt-cdi-importer-rhel9@sha256:84d3534ff8027475d41f6dee3c827640905b98dc5251c6a31abad5c7d4cdb2dc" already present on machine 63s Normal Created pod/importer-prime-f8306d83-5a9c-4559-837b-af37c4942e4e Created container: importer 63s Normal Started pod/importer-prime-f8306d83-5a9c-4559-837b-af37c4942e4e Started container importer 63s Normal Pulled pod/importer-prime-f8306d83-5a9c-4559-837b-af37c4942e4e Container image "quay.io/kubevirt/fedora-with-test-tooling-container-disk" already present on machine 63s Normal Created pod/importer-prime-f8306d83-5a9c-4559-837b-af37c4942e4e Created container: server 63s Normal Started pod/importer-prime-f8306d83-5a9c-4559-837b-af37c4942e4e Started container server 81s Warning ProvisioningFailed persistentvolumeclaim/prime-f8306d83-5a9c-4559-837b-af37c4942e4e Error saving claim: Operation cannot be fulfilled on persistentvolumeclaims "prime-f8306d83-5a9c-4559-837b-af37c4942e4e": the object has been modified; please apply your changes to the latest version and try again 72s Normal ExternalProvisioning persistentvolumeclaim/prime-f8306d83-5a9c-4559-837b-af37c4942e4e Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 72s Normal Provisioning persistentvolumeclaim/prime-f8306d83-5a9c-4559-837b-af37c4942e4e External provisioner is provisioning volume for claim "test-oadp-186/prime-f8306d83-5a9c-4559-837b-af37c4942e4e" 72s Normal ProvisioningSucceeded persistentvolumeclaim/prime-f8306d83-5a9c-4559-837b-af37c4942e4e Successfully provisioned volume pvc-696385ea-6b12-4010-b0c7-d8649db9b0ab 45s Normal ImportSucceeded persistentvolumeclaim/prime-f8306d83-5a9c-4559-837b-af37c4942e4e Import Successful 42s Warning ClaimMisbound persistentvolumeclaim/prime-f8306d83-5a9c-4559-837b-af37c4942e4e Two claims are bound to the same volume, this one is bound incorrectly 40s Warning UnrecognizedDataSourceKind persistentvolumeclaim/test-vm-dv The datasource for this PVC does not match any registered VolumePopulator 81s Normal CreatedPVCPrimeSuccessfully persistentvolumeclaim/test-vm-dv PVC Prime created successfully 81s Normal Pending datavolume/test-vm-dv PVC test-vm-dv Pending 81s Warning ProvisioningFailed persistentvolumeclaim/test-vm-dv Error saving claim: Operation cannot be fulfilled on persistentvolumeclaims "test-vm-dv": the object has been modified; please apply your changes to the latest version and try again 81s Warning Unschedulable datavolume/test-vm-dv Importer pod cannot be scheduled 44s Normal ExternalProvisioning persistentvolumeclaim/test-vm-dv Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 44s Normal Provisioning persistentvolumeclaim/test-vm-dv External provisioner is provisioning volume for claim "test-oadp-186/test-vm-dv" 44s Normal Provisioning persistentvolumeclaim/test-vm-dv Assuming an external populator will provision the volume 72s Normal ImportScheduled datavolume/test-vm-dv Import into test-vm-dv scheduled 62s Normal ImportInProgress datavolume/test-vm-dv Import into test-vm-dv in progress 47s Warning Completed datavolume/test-vm-dv Import Complete 44s Normal ImportSucceeded datavolume/test-vm-dv Successfully imported into PVC test-vm-dv 42s Normal importSucceeded persistentvolumeclaim/test-vm-dv Successfully imported into test-vm-dv 44s Normal Bound datavolume/test-vm-dv PVC test-vm-dv Bound 81s Normal SuccessfulDataVolumeCreate virtualmachine/test-vm Created DataVolume test-vm-dv 44s Normal SuccessfulCreate virtualmachine/test-vm Started the virtual machine by creating the new virtual machine instance test-vm 44s Normal SuccessfulCreate virtualmachineinstance/test-vm Created virtual machine pod virt-launcher-test-vm-sdfcx 29s Normal Created virtualmachineinstance/test-vm VirtualMachineInstance defined. 7s Warning Migrated virtualmachineinstance/test-vm EvictionStrategy is set but vmi is not migratable; cannot migrate VMI: PVC test-vm-dv is not shared, live migration requires that all PVCs must be shared (using ReadWriteMany access mode) 29s Normal Started virtualmachineinstance/test-vm VirtualMachineInstance started. 7s Normal SuccessfulDelete virtualmachine/test-vm Stopped the virtual machine by deleting the virtual machine instance be2a361e-4df4-4d98-be93-b1ac7f3c4153 3s Normal SuccessfulDelete virtualmachineinstance/test-vm Deleted virtual machine pod virt-launcher-test-vm-sdfcx 7s Normal Deleted virtualmachineinstance/test-vm VirtualMachineInstance stopping 7s Normal Deleted virtualmachineinstance/test-vm Signaled Deletion 7s Normal Stopped virtualmachineinstance/test-vm The VirtualMachineInstance was shut down. 43s Normal Scheduled pod/virt-launcher-test-vm-sdfcx Successfully assigned test-oadp-186/virt-launcher-test-vm-sdfcx to ip-10-0-60-83.us-east-2.compute.internal 43s Normal SuccessfulAttachVolume pod/virt-launcher-test-vm-sdfcx AttachVolume.Attach succeeded for volume "pvc-696385ea-6b12-4010-b0c7-d8649db9b0ab" 34s Normal SuccessfulMountVolume pod/virt-launcher-test-vm-sdfcx MapVolume.MapPodDevice succeeded for volume "pvc-696385ea-6b12-4010-b0c7-d8649db9b0ab" globalMapPath "/var/lib/kubelet/plugins/kubernetes.io/csi/volumeDevices/pvc-696385ea-6b12-4010-b0c7-d8649db9b0ab/dev" 34s Normal SuccessfulMountVolume pod/virt-launcher-test-vm-sdfcx MapVolume.MapPodDevice succeeded for volume "pvc-696385ea-6b12-4010-b0c7-d8649db9b0ab" volumeMapPath "/var/lib/kubelet/pods/1af60616-9fa9-4564-83bb-ef4ad9f00692/volumeDevices/kubernetes.io~csi" 33s Normal AddedInterface pod/virt-launcher-test-vm-sdfcx Add eth0 [10.129.2.116/23] from ovn-kubernetes 33s Normal Pulled pod/virt-launcher-test-vm-sdfcx Container image "registry.redhat.io/container-native-virtualization/virt-launcher-rhel9@sha256:3138ad3a4471ca69be37fbe50a96be4b89e120de0e2808067ca99ff576f16256" already present on machine 33s Normal Created pod/virt-launcher-test-vm-sdfcx Created container: guest-console-log 33s Normal Started pod/virt-launcher-test-vm-sdfcx Started container guest-console-log 32s Normal Pulled pod/virt-launcher-test-vm-sdfcx Container image "registry.redhat.io/container-native-virtualization/virt-launcher-rhel9@sha256:3138ad3a4471ca69be37fbe50a96be4b89e120de0e2808067ca99ff576f16256" already present on machine 31s Normal Created pod/virt-launcher-test-vm-sdfcx Created container: compute 31s Normal Started pod/virt-launcher-test-vm-sdfcx Started container compute 7s Normal Killing pod/virt-launcher-test-vm-sdfcx Stopping container guest-console-log 7s Normal Killing pod/virt-launcher-test-vm-sdfcx Stopping container compute [FAILED] in [It] - /alabama/cspi/test_common/backup_restore_app_case.go:52 @ 02/05/26 16:42:50.504 < Exit [It] [tc-id:OADP-186] [kubevirt] [Tier0] [vf:vm] Stopped VM should be restored @ 02/05/26 16:42:50.504 (1m34.373s) > Enter [JustAfterEach] TOP-LEVEL @ 02/05/26 16:42:50.504 2026/02/05 16:42:50 Using Must-gather image: registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 STEP: Get the failed spec name @ 02/05/26 16:42:50.504 2026/02/05 16:42:50 The failed spec name is: CSI: Backup/Restore Openshift Virtualization Workloads [tc-id:OADP-186] [kubevirt] [Tier0] [vf:vm] Stopped VM should be restored STEP: Create a folder for all must-gather files if it doesn't exists already @ 02/05/26 16:42:50.504 STEP: Create a folder for the failed spec if it doesn't exists already @ 02/05/26 16:42:50.504 2026/02/05 16:42:50 The folder logs/It_CSI_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-186_kubevirt_Tier0_vf_vm_Stopped_VM_should_be_restored does not exists, creating new folder with the name: logs/It_CSI_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-186_kubevirt_Tier0_vf_vm_Stopped_VM_should_be_restored STEP: Run must-gather because the spec failed @ 02/05/26 16:42:50.504 2026/02/05 16:42:50 Log the present working directory path:- /alabama/cspi/e2e/kubevirt-plugin 2026/02/05 16:42:50 [adm must-gather --dest-dir /alabama/cspi/e2e/kubevirt-plugin/logs/It_CSI_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-186_kubevirt_Tier0_vf_vm_Stopped_VM_should_be_restored --image registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3] 2026/02/05 16:43:01 Log all the files present in /alabama/cspi/e2e/kubevirt-plugin/logs directory 2026/02/05 16:43:01 It_CSI_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-185_kubevirt_Tier0_vf_vm_Backing_up_started_VM_should_succeed 2026/02/05 16:43:01 It_CSI_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-186_kubevirt_Tier0_vf_vm_Stopped_VM_should_be_restored 2026/02/05 16:43:01 It_Native_CSI_Data_Mover_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-401_kubevirt_Tier1_Started_VM_should_over_ceph_filesytem_mode STEP: Find must-gather folder and rename it to a shorter more readable name @ 02/05/26 16:43:01.163 < Exit [JustAfterEach] TOP-LEVEL @ 02/05/26 16:43:01.163 (10.659s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:43:01.163 2026/02/05 16:43:01 Cleaning app 2026/02/05 16:43:01 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11  30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11  40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18  49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}"  ^ column 18  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Cleanup resources] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/cleanup.yml for localhost [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-186] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=22  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026/02/05 16:43:27 2026-02-05 16:43:02,894 p=28637 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:43:02,894 p=28637 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:43:03,223 p=28637 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:43:03,224 p=28637 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:43:03,540 p=28637 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:43:03,540 p=28637 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:43:03,860 p=28637 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:43:03,861 p=28637 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:43:03,879 p=28637 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:43:03,879 p=28637 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:43:03,879 p=28637 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:43:03,899 p=28637 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:43:03,900 p=28637 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:43:03,914 p=28637 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:43:03,915 p=28637 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:43:04,345 p=28637 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:43:04,345 p=28637 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:43:04,346 p=28637 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:43:04,346 p=28637 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:43:04,373 p=28637 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:43:04,374 p=28637 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:43:04,395 p=28637 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:43:04,395 p=28637 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:43:04,398 p=28637 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:43:05,004 p=28637 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:43:05,004 p=28637 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:43:05,250 p=28637 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** 2026-02-05 16:43:05,251 p=28637 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:43:05,511 p=28637 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** 2026-02-05 16:43:05,511 p=28637 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:43:05,886 p=28637 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** 2026-02-05 16:43:05,887 p=28637 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11 30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:43:05,887 p=28637 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:43:06,258 p=28637 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** 2026-02-05 16:43:06,258 p=28637 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11 40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:43:06,259 p=28637 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:43:06,283 p=28637 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** 2026-02-05 16:43:06,283 p=28637 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18 49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}" ^ column 18 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:43:06,283 p=28637 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:43:06,303 p=28637 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Cleanup resources] *** 2026-02-05 16:43:06,312 p=28637 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/cleanup.yml for localhost 2026-02-05 16:43:27,491 p=28637 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-186] *** 2026-02-05 16:43:27,491 p=28637 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:43:27,492 p=28637 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:43:27,492 p=28637 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:43:27,492 p=28637 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:43:27,492 p=28637 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:43:27,553 p=28637 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:43:27,553 p=28637 u=1001930000 n=ansible INFO| localhost : ok=22 changed=5 unreachable=0 failed=0 skipped=6 rescued=0 ignored=0 < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:43:27.613 (26.449s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:43:27.613 2026/02/05 16:43:27 Cleaning setup resources for the backup 2026/02/05 16:43:27 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 16:43:27 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2026/02/05 16:43:27 Deleting VolumeSnapshotClass 'example-snapclass' < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:43:27.648 (35ms) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:43:27.648 2026/02/05 16:43:27 Deleting DPA CR < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:43:27.66 (13ms) Attempt #1 Failed. Retrying ↺ @ 02/05/26 16:43:27.661 > Enter [BeforeEach] CSI: Backup/Restore Openshift Virtualization Workloads @ 02/05/26 16:43:27.661 < Exit [BeforeEach] CSI: Backup/Restore Openshift Virtualization Workloads @ 02/05/26 16:43:27.678 (18ms) > Enter [JustBeforeEach] TOP-LEVEL @ 02/05/26 16:43:27.678 < Exit [JustBeforeEach] TOP-LEVEL @ 02/05/26 16:43:27.678 (0s) > Enter [It] [tc-id:OADP-186] [kubevirt] [Tier0] [vf:vm] Stopped VM should be restored @ 02/05/26 16:43:27.678 2026/02/05 16:43:27 Delete all downloadrequest No download requests are found STEP: Create DPA CR @ 02/05/26 16:43:27.703 2026/02/05 16:43:27 csi 2026/02/05 16:43:27 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "e63e9613-9382-4d9d-9e2a-d5d60bbac012", "resourceVersion": "87416", "generation": 1, "creationTimestamp": "2026-02-05T16:43:27Z", "managedFields": [ { "manager": "kubevirt-plugin.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T16:43:27Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "kubevirt" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false } }, "features": null, "logFormat": "text" }, "status": {} } Delete all the backups that remained in the phase InProgress Deleting backup CRs in progress Deletion of backup CRs in progress completed Delete all the restores that remained in the phase InProgress Deleting restore CRs in progress Deletion of restore CRs in progress completed STEP: Verify DPA CR setup @ 02/05/26 16:43:27.749 2026/02/05 16:43:27 Waiting for velero pod to be running 2026/02/05 16:43:27 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete' 2026/02/05 16:43:27 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "e63e9613-9382-4d9d-9e2a-d5d60bbac012", "resourceVersion": "87416", "generation": 1, "creationTimestamp": "2026-02-05T16:43:27Z", "managedFields": [ { "manager": "kubevirt-plugin.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T16:43:27Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "kubevirt" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false } }, "features": null, "logFormat": "text" }, "status": {} } 2026/02/05 16:43:32 DPA successfully reconciled STEP: Prepare backup resources, depending on the volumes backup type @ 02/05/26 16:43:32.78 2026/02/05 16:43:32 Snapclass 'example-snapclass' doesn't exist, creating 2026/02/05 16:43:32 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 16:43:32 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd STEP: Installing application for case ocp-kubevirt @ 02/05/26 16:43:32.91 2026/02/05 16:43:32 🔄 [Attempt 1/3] Executing operation: Deploy application ocp-kubevirt 2026/02/05 16:43:32 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11  30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11  40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18  49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}"  ^ column 18  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create resources] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml for localhost [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create namespace] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Deploy VM test-vm] *** changed: [localhost] FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (60 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (59 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (58 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (57 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (56 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (55 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (54 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (53 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (52 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:44:11  42 --command "echo '{{ text_content }}' > {{ file_path }}" 43 environment: 44 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  FAILED - RETRYING: [localhost]: Run echo command on the VM (60 retries left). FAILED - RETRYING: [localhost]: Run echo command on the VM (59 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Run echo command on the VM] *** changed: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:60:11  58 --command "cat {{ file_path }}" 59 environment: 60 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify file creation and content] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Display confirmation message] *** ok: [localhost] => {  "msg": "Text content written to '/home/fedora/test' on the VM 'test-vm' successfully." } TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Shutdown the VM if required] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM status to become 'Stopped'] *** ok: [localhost] PLAY RECAP ********************************************************************* localhost : ok=29  changed=9  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026/02/05 16:44:56 2026-02-05 16:43:34,619 p=28911 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:43:34,619 p=28911 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:43:34,946 p=28911 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:43:34,946 p=28911 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:43:35,258 p=28911 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:43:35,259 p=28911 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:43:35,576 p=28911 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:43:35,576 p=28911 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:43:35,594 p=28911 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:43:35,594 p=28911 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:43:35,595 p=28911 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:43:35,616 p=28911 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:43:35,617 p=28911 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:43:35,634 p=28911 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:43:35,634 p=28911 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:43:36,080 p=28911 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:43:36,081 p=28911 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:43:36,081 p=28911 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:43:36,081 p=28911 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:43:36,109 p=28911 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:43:36,109 p=28911 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:43:36,131 p=28911 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:43:36,132 p=28911 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:43:36,135 p=28911 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:43:36,750 p=28911 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:43:36,750 p=28911 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:43:37,019 p=28911 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** 2026-02-05 16:43:37,019 p=28911 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:43:37,284 p=28911 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** 2026-02-05 16:43:37,284 p=28911 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:43:37,671 p=28911 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** 2026-02-05 16:43:37,671 p=28911 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11 30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:43:37,671 p=28911 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:43:38,052 p=28911 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** 2026-02-05 16:43:38,053 p=28911 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11 40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:43:38,053 p=28911 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:43:38,079 p=28911 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** 2026-02-05 16:43:38,080 p=28911 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18 49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}" ^ column 18 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:43:38,080 p=28911 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:43:38,125 p=28911 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create resources] *** 2026-02-05 16:43:38,141 p=28911 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml for localhost 2026-02-05 16:43:39,281 p=28911 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create namespace] *** 2026-02-05 16:43:39,282 p=28911 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:43:39,282 p=28911 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:43:39,282 p=28911 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:43:39,283 p=28911 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:43:39,283 p=28911 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:43:40,380 p=28911 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Deploy VM test-vm] *** 2026-02-05 16:43:40,381 p=28911 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:43:41,649 p=28911 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (60 retries left). 2026-02-05 16:43:47,556 p=28911 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (59 retries left). 2026-02-05 16:43:53,473 p=28911 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (58 retries left). 2026-02-05 16:43:59,443 p=28911 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (57 retries left). 2026-02-05 16:44:05,392 p=28911 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (56 retries left). 2026-02-05 16:44:11,356 p=28911 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (55 retries left). 2026-02-05 16:44:17,304 p=28911 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (54 retries left). 2026-02-05 16:44:23,419 p=28911 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (53 retries left). 2026-02-05 16:44:29,981 p=28911 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (52 retries left). 2026-02-05 16:44:35,997 p=28911 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** 2026-02-05 16:44:35,998 p=28911 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:44:39,451 p=28911 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Run echo command on the VM (60 retries left). 2026-02-05 16:44:47,893 p=28911 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Run echo command on the VM (59 retries left). 2026-02-05 16:44:54,041 p=28911 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Run echo command on the VM] *** 2026-02-05 16:44:54,042 p=28911 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:44:11 42 --command "echo '{{ text_content }}' > {{ file_path }}" 43 environment: 44 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:44:54,042 p=28911 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:44:54,584 p=28911 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify file creation and content] *** 2026-02-05 16:44:54,585 p=28911 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:60:11 58 --command "cat {{ file_path }}" 59 environment: 60 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:44:54,585 p=28911 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:44:54,602 p=28911 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Display confirmation message] *** 2026-02-05 16:44:54,602 p=28911 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Text content written to '/home/fedora/test' on the VM 'test-vm' successfully." } 2026-02-05 16:44:55,573 p=28911 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Shutdown the VM if required] *** 2026-02-05 16:44:55,574 p=28911 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:44:56,544 p=28911 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM status to become 'Stopped'] *** 2026-02-05 16:44:56,545 p=28911 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:44:56,570 p=28911 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:44:56,570 p=28911 u=1001930000 n=ansible INFO| localhost : ok=29 changed=9 unreachable=0 failed=0 skipped=5 rescued=0 ignored=0 STEP: Verify Application deployment @ 02/05/26 16:44:56.63 2026/02/05 16:44:56 Using admin kubeconfig for with_validate operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11  30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11  40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18  49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}"  ^ column 18  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Validate migration] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml for localhost TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify VM is not in running state] *** [ERROR]: Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:11:10'. Conditionals must have a boolean result.  Task failed. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:1:3  1 - name: Verify VM is not in running state  ^ column 3  <<< caused by >>>  Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:11:10'. Conditionals must have a boolean result. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:11:10   9 verify_ssl: no 10 register: vm 11 until: vm.resources[0].status.conditions | selectattr('type', 'equalto', 'Ready') | selectattr('status', 'equalt...  ^ column 10  Broken conditionals can be temporarily allowed with the `ALLOW_BROKEN_CONDITIONALS` configuration option.  fatal: [localhost]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:11:10'. Conditionals must have a boolean result."} PLAY RECAP ********************************************************************* localhost : ok=21  changed=4  unreachable=0 failed=1  skipped=5  rescued=0 ignored=0 2026/02/05 16:45:04 2026-02-05 16:44:58,366 p=29516 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:44:58,367 p=29516 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:44:58,682 p=29516 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:44:58,682 p=29516 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:44:59,010 p=29516 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:44:59,011 p=29516 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:44:59,477 p=29516 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:44:59,477 p=29516 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:44:59,505 p=29516 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:44:59,506 p=29516 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:44:59,506 p=29516 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:44:59,539 p=29516 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:44:59,540 p=29516 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:44:59,564 p=29516 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:44:59,565 p=29516 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:45:00,113 p=29516 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:45:00,114 p=29516 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:45:00,114 p=29516 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:45:00,114 p=29516 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:00,146 p=29516 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:45:00,147 p=29516 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:00,170 p=29516 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:45:00,170 p=29516 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:00,173 p=29516 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:45:00,828 p=29516 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:45:00,828 p=29516 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:01,247 p=29516 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** 2026-02-05 16:45:01,247 p=29516 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:01,665 p=29516 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** 2026-02-05 16:45:01,665 p=29516 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:02,294 p=29516 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** 2026-02-05 16:45:02,294 p=29516 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11 30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:45:02,295 p=29516 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:02,891 p=29516 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** 2026-02-05 16:45:02,892 p=29516 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11 40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:45:02,892 p=29516 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:02,934 p=29516 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** 2026-02-05 16:45:02,935 p=29516 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18 49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}" ^ column 18 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:45:02,935 p=29516 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:03,031 p=29516 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Validate migration] *** 2026-02-05 16:45:03,052 p=29516 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml for localhost 2026-02-05 16:45:04,795 p=29516 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify VM is not in running state] *** 2026-02-05 16:45:04,796 p=29516 u=1001930000 n=ansible ERROR| [ERROR]: Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:11:10'. Conditionals must have a boolean result. Task failed. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:1:3 1 - name: Verify VM is not in running state ^ column 3 <<< caused by >>> Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:11:10'. Conditionals must have a boolean result. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:11:10 9 verify_ssl: no 10 register: vm 11 until: vm.resources[0].status.conditions | selectattr('type', 'equalto', 'Ready') | selectattr('status', 'equalt... ^ column 10 Broken conditionals can be temporarily allowed with the `ALLOW_BROKEN_CONDITIONALS` configuration option. 2026-02-05 16:45:04,796 p=29516 u=1001930000 n=ansible INFO| fatal: [localhost]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:11:10'. Conditionals must have a boolean result."} 2026-02-05 16:45:04,797 p=29516 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:45:04,797 p=29516 u=1001930000 n=ansible INFO| localhost : ok=21 changed=4 unreachable=0 failed=1 skipped=5 rescued=0 ignored=0 Run the command: oc get event -n test-oadp-186 2026/02/05 16:45:04 LAST SEEN TYPE REASON OBJECT MESSAGE 84s Warning FailedScheduling pod/importer-prime-03365e7e-65b3-46bd-bf6d-4415790c2310 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 71s Warning FailedScheduling pod/importer-prime-03365e7e-65b3-46bd-bf6d-4415790c2310 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 71s Normal Scheduled pod/importer-prime-03365e7e-65b3-46bd-bf6d-4415790c2310 Successfully assigned test-oadp-186/importer-prime-03365e7e-65b3-46bd-bf6d-4415790c2310 to ip-10-0-60-83.us-east-2.compute.internal 70s Normal SuccessfulAttachVolume pod/importer-prime-03365e7e-65b3-46bd-bf6d-4415790c2310 AttachVolume.Attach succeeded for volume "pvc-f1fb5f20-9240-44a2-a3e0-7e4a2409cd5a" 66s Normal SuccessfulMountVolume pod/importer-prime-03365e7e-65b3-46bd-bf6d-4415790c2310 MapVolume.MapPodDevice succeeded for volume "pvc-f1fb5f20-9240-44a2-a3e0-7e4a2409cd5a" globalMapPath "/var/lib/kubelet/plugins/kubernetes.io/csi/volumeDevices/pvc-f1fb5f20-9240-44a2-a3e0-7e4a2409cd5a/dev" 66s Normal SuccessfulMountVolume pod/importer-prime-03365e7e-65b3-46bd-bf6d-4415790c2310 MapVolume.MapPodDevice succeeded for volume "pvc-f1fb5f20-9240-44a2-a3e0-7e4a2409cd5a" volumeMapPath "/var/lib/kubelet/pods/bbcb4b36-70b8-41c1-8282-4cfe4089064e/volumeDevices/kubernetes.io~csi" 65s Normal AddedInterface pod/importer-prime-03365e7e-65b3-46bd-bf6d-4415790c2310 Add eth0 [10.129.2.119/23] from ovn-kubernetes 65s Normal Pulled pod/importer-prime-03365e7e-65b3-46bd-bf6d-4415790c2310 Container image "registry.redhat.io/container-native-virtualization/virt-cdi-importer-rhel9@sha256:84d3534ff8027475d41f6dee3c827640905b98dc5251c6a31abad5c7d4cdb2dc" already present on machine 65s Normal Created pod/importer-prime-03365e7e-65b3-46bd-bf6d-4415790c2310 Created container: init 65s Normal Started pod/importer-prime-03365e7e-65b3-46bd-bf6d-4415790c2310 Started container init 65s Normal Pulled pod/importer-prime-03365e7e-65b3-46bd-bf6d-4415790c2310 Container image "registry.redhat.io/container-native-virtualization/virt-cdi-importer-rhel9@sha256:84d3534ff8027475d41f6dee3c827640905b98dc5251c6a31abad5c7d4cdb2dc" already present on machine 65s Normal Created pod/importer-prime-03365e7e-65b3-46bd-bf6d-4415790c2310 Created container: importer 65s Normal Started pod/importer-prime-03365e7e-65b3-46bd-bf6d-4415790c2310 Started container importer 65s Normal Pulled pod/importer-prime-03365e7e-65b3-46bd-bf6d-4415790c2310 Container image "quay.io/kubevirt/fedora-with-test-tooling-container-disk" already present on machine 65s Normal Created pod/importer-prime-03365e7e-65b3-46bd-bf6d-4415790c2310 Created container: server 65s Normal Started pod/importer-prime-03365e7e-65b3-46bd-bf6d-4415790c2310 Started container server 84s Warning ProvisioningFailed persistentvolumeclaim/prime-03365e7e-65b3-46bd-bf6d-4415790c2310 Error saving claim: Operation cannot be fulfilled on persistentvolumeclaims "prime-03365e7e-65b3-46bd-bf6d-4415790c2310": the object has been modified; please apply your changes to the latest version and try again 71s Normal ExternalProvisioning persistentvolumeclaim/prime-03365e7e-65b3-46bd-bf6d-4415790c2310 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 71s Normal Provisioning persistentvolumeclaim/prime-03365e7e-65b3-46bd-bf6d-4415790c2310 External provisioner is provisioning volume for claim "test-oadp-186/prime-03365e7e-65b3-46bd-bf6d-4415790c2310" 71s Normal ProvisioningSucceeded persistentvolumeclaim/prime-03365e7e-65b3-46bd-bf6d-4415790c2310 Successfully provisioned volume pvc-f1fb5f20-9240-44a2-a3e0-7e4a2409cd5a 45s Normal ImportSucceeded persistentvolumeclaim/prime-03365e7e-65b3-46bd-bf6d-4415790c2310 Import Successful 41s Warning ClaimMisbound persistentvolumeclaim/prime-03365e7e-65b3-46bd-bf6d-4415790c2310 Two claims are bound to the same volume, this one is bound incorrectly 43s Warning UnrecognizedDataSourceKind persistentvolumeclaim/test-vm-dv The datasource for this PVC does not match any registered VolumePopulator 84s Normal CreatedPVCPrimeSuccessfully persistentvolumeclaim/test-vm-dv PVC Prime created successfully 84s Normal Pending datavolume/test-vm-dv PVC test-vm-dv Pending 43s Normal Provisioning persistentvolumeclaim/test-vm-dv External provisioner is provisioning volume for claim "test-oadp-186/test-vm-dv" 43s Normal Provisioning persistentvolumeclaim/test-vm-dv Assuming an external populator will provision the volume 43s Normal ExternalProvisioning persistentvolumeclaim/test-vm-dv Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 84s Warning Unschedulable datavolume/test-vm-dv Importer pod cannot be scheduled 71s Normal ImportScheduled datavolume/test-vm-dv Import into test-vm-dv scheduled 64s Normal ImportInProgress datavolume/test-vm-dv Import into test-vm-dv in progress 48s Warning Completed datavolume/test-vm-dv Import Complete 41s Normal importSucceeded persistentvolumeclaim/test-vm-dv Successfully imported into test-vm-dv 43s Normal ImportSucceeded datavolume/test-vm-dv Successfully imported into PVC test-vm-dv 43s Normal Bound datavolume/test-vm-dv PVC test-vm-dv Bound 84s Normal SuccessfulDataVolumeCreate virtualmachine/test-vm Created DataVolume test-vm-dv 43s Normal SuccessfulCreate virtualmachine/test-vm Started the virtual machine by creating the new virtual machine instance test-vm 43s Normal SuccessfulCreate virtualmachineinstance/test-vm Created virtual machine pod virt-launcher-test-vm-x2xcr 31s Normal Created virtualmachineinstance/test-vm VirtualMachineInstance defined. 9s Warning Migrated virtualmachineinstance/test-vm EvictionStrategy is set but vmi is not migratable; cannot migrate VMI: PVC test-vm-dv is not shared, live migration requires that all PVCs must be shared (using ReadWriteMany access mode) 31s Normal Started virtualmachineinstance/test-vm VirtualMachineInstance started. 9s Normal SuccessfulDelete virtualmachine/test-vm Stopped the virtual machine by deleting the virtual machine instance 0e754eb7-78c3-486e-94a7-40d17d05dea3 5s Normal SuccessfulDelete virtualmachineinstance/test-vm Deleted virtual machine pod virt-launcher-test-vm-x2xcr 9s Normal Deleted virtualmachineinstance/test-vm VirtualMachineInstance stopping 9s Normal Deleted virtualmachineinstance/test-vm Signaled Deletion 9s Normal Stopped virtualmachineinstance/test-vm The VirtualMachineInstance was shut down. 43s Normal Scheduled pod/virt-launcher-test-vm-x2xcr Successfully assigned test-oadp-186/virt-launcher-test-vm-x2xcr to ip-10-0-60-83.us-east-2.compute.internal 35s Normal SuccessfulMountVolume pod/virt-launcher-test-vm-x2xcr MapVolume.MapPodDevice succeeded for volume "pvc-f1fb5f20-9240-44a2-a3e0-7e4a2409cd5a" globalMapPath "/var/lib/kubelet/plugins/kubernetes.io/csi/volumeDevices/pvc-f1fb5f20-9240-44a2-a3e0-7e4a2409cd5a/dev" 35s Normal SuccessfulMountVolume pod/virt-launcher-test-vm-x2xcr MapVolume.MapPodDevice succeeded for volume "pvc-f1fb5f20-9240-44a2-a3e0-7e4a2409cd5a" volumeMapPath "/var/lib/kubelet/pods/598b83cf-928d-414b-8959-18988398d1fe/volumeDevices/kubernetes.io~csi" 35s Normal AddedInterface pod/virt-launcher-test-vm-x2xcr Add eth0 [10.129.2.121/23] from ovn-kubernetes 35s Normal Pulled pod/virt-launcher-test-vm-x2xcr Container image "registry.redhat.io/container-native-virtualization/virt-launcher-rhel9@sha256:3138ad3a4471ca69be37fbe50a96be4b89e120de0e2808067ca99ff576f16256" already present on machine 34s Normal Created pod/virt-launcher-test-vm-x2xcr Created container: guest-console-log 34s Normal Started pod/virt-launcher-test-vm-x2xcr Started container guest-console-log 33s Normal Pulled pod/virt-launcher-test-vm-x2xcr Container image "registry.redhat.io/container-native-virtualization/virt-launcher-rhel9@sha256:3138ad3a4471ca69be37fbe50a96be4b89e120de0e2808067ca99ff576f16256" already present on machine 33s Normal Created pod/virt-launcher-test-vm-x2xcr Created container: compute 33s Normal Started pod/virt-launcher-test-vm-x2xcr Started container compute 9s Normal Killing pod/virt-launcher-test-vm-x2xcr Stopping container guest-console-log 9s Normal Killing pod/virt-launcher-test-vm-x2xcr Stopping container compute [FAILED] in [It] - /alabama/cspi/test_common/backup_restore_app_case.go:52 @ 02/05/26 16:45:04.987 < Exit [It] [tc-id:OADP-186] [kubevirt] [Tier0] [vf:vm] Stopped VM should be restored @ 02/05/26 16:45:04.987 (1m37.309s) > Enter [JustAfterEach] TOP-LEVEL @ 02/05/26 16:45:04.987 2026/02/05 16:45:04 Using Must-gather image: registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 STEP: Get the failed spec name @ 02/05/26 16:45:04.987 2026/02/05 16:45:04 The failed spec name is: CSI: Backup/Restore Openshift Virtualization Workloads [tc-id:OADP-186] [kubevirt] [Tier0] [vf:vm] Stopped VM should be restored STEP: Create a folder for all must-gather files if it doesn't exists already @ 02/05/26 16:45:04.987 STEP: Create a folder for the failed spec if it doesn't exists already @ 02/05/26 16:45:04.987 STEP: Run must-gather because the spec failed @ 02/05/26 16:45:04.987 2026/02/05 16:45:04 Log the present working directory path:- /alabama/cspi/e2e/kubevirt-plugin 2026/02/05 16:45:04 [adm must-gather --dest-dir /alabama/cspi/e2e/kubevirt-plugin/logs/It_CSI_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-186_kubevirt_Tier0_vf_vm_Stopped_VM_should_be_restored --image registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3] 2026/02/05 16:45:16 Log all the files present in /alabama/cspi/e2e/kubevirt-plugin/logs directory 2026/02/05 16:45:16 It_CSI_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-185_kubevirt_Tier0_vf_vm_Backing_up_started_VM_should_succeed 2026/02/05 16:45:16 It_CSI_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-186_kubevirt_Tier0_vf_vm_Stopped_VM_should_be_restored 2026/02/05 16:45:16 It_Native_CSI_Data_Mover_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-401_kubevirt_Tier1_Started_VM_should_over_ceph_filesytem_mode STEP: Find must-gather folder and rename it to a shorter more readable name @ 02/05/26 16:45:16.265 The folder logs/It_CSI_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-186_kubevirt_Tier0_vf_vm_Stopped_VM_should_be_restored/must-gather already exists, skipping renaming the folder < Exit [JustAfterEach] TOP-LEVEL @ 02/05/26 16:45:16.265 (11.278s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:45:16.265 2026/02/05 16:45:16 Cleaning app 2026/02/05 16:45:16 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11  30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11  40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18  49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}"  ^ column 18  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Cleanup resources] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/cleanup.yml for localhost [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-186] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=22  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026/02/05 16:45:45 2026-02-05 16:45:18,979 p=29834 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:45:18,979 p=29834 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:45:19,553 p=29834 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:45:19,553 p=29834 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:45:20,183 p=29834 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:45:20,184 p=29834 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:45:20,729 p=29834 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:45:20,729 p=29834 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:45:20,759 p=29834 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:45:20,760 p=29834 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:45:20,760 p=29834 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:20,800 p=29834 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:45:20,800 p=29834 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:20,826 p=29834 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:45:20,827 p=29834 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:45:21,485 p=29834 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:45:21,486 p=29834 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:45:21,487 p=29834 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:45:21,487 p=29834 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:21,530 p=29834 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:45:21,530 p=29834 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:21,563 p=29834 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:45:21,563 p=29834 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:21,568 p=29834 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:45:22,334 p=29834 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:45:22,334 p=29834 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:22,614 p=29834 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** 2026-02-05 16:45:22,614 p=29834 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:22,985 p=29834 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** 2026-02-05 16:45:22,985 p=29834 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:23,432 p=29834 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** 2026-02-05 16:45:23,433 p=29834 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11 30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:45:23,433 p=29834 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:23,891 p=29834 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** 2026-02-05 16:45:23,892 p=29834 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11 40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:45:23,892 p=29834 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:23,920 p=29834 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** 2026-02-05 16:45:23,921 p=29834 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18 49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}" ^ column 18 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:45:23,921 p=29834 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:23,941 p=29834 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Cleanup resources] *** 2026-02-05 16:45:23,952 p=29834 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/cleanup.yml for localhost 2026-02-05 16:45:45,219 p=29834 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-186] *** 2026-02-05 16:45:45,219 p=29834 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:45:45,220 p=29834 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:45:45,220 p=29834 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:45:45,220 p=29834 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:45:45,220 p=29834 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:45:45,280 p=29834 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:45:45,280 p=29834 u=1001930000 n=ansible INFO| localhost : ok=22 changed=5 unreachable=0 failed=0 skipped=6 rescued=0 ignored=0 < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:45:45.348 (29.083s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:45:45.348 2026/02/05 16:45:45 Cleaning setup resources for the backup 2026/02/05 16:45:45 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 16:45:45 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2026/02/05 16:45:45 Deleting VolumeSnapshotClass 'example-snapclass' < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:45:45.376 (28ms) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:45:45.376 2026/02/05 16:45:45 Deleting DPA CR < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:45:45.382 (6ms) Attempt #2 Failed. Retrying ↺ @ 02/05/26 16:45:45.382 > Enter [BeforeEach] CSI: Backup/Restore Openshift Virtualization Workloads @ 02/05/26 16:45:45.382 < Exit [BeforeEach] CSI: Backup/Restore Openshift Virtualization Workloads @ 02/05/26 16:45:45.392 (10ms) > Enter [JustBeforeEach] TOP-LEVEL @ 02/05/26 16:45:45.392 < Exit [JustBeforeEach] TOP-LEVEL @ 02/05/26 16:45:45.392 (0s) > Enter [It] [tc-id:OADP-186] [kubevirt] [Tier0] [vf:vm] Stopped VM should be restored @ 02/05/26 16:45:45.392 2026/02/05 16:45:45 Delete all downloadrequest No download requests are found STEP: Create DPA CR @ 02/05/26 16:45:45.403 2026/02/05 16:45:45 csi 2026/02/05 16:45:45 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "2b2198a6-be4c-4db4-914e-4577bde886c3", "resourceVersion": "90005", "generation": 1, "creationTimestamp": "2026-02-05T16:45:45Z", "managedFields": [ { "manager": "kubevirt-plugin.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T16:45:45Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "kubevirt" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false } }, "features": null, "logFormat": "text" }, "status": {} } Delete all the backups that remained in the phase InProgress Deleting backup CRs in progress Deletion of backup CRs in progress completed Delete all the restores that remained in the phase InProgress Deleting restore CRs in progress Deletion of restore CRs in progress completed STEP: Verify DPA CR setup @ 02/05/26 16:45:45.481 2026/02/05 16:45:45 Waiting for velero pod to be running 2026/02/05 16:45:45 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete' 2026/02/05 16:45:45 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "2b2198a6-be4c-4db4-914e-4577bde886c3", "resourceVersion": "90005", "generation": 1, "creationTimestamp": "2026-02-05T16:45:45Z", "managedFields": [ { "manager": "kubevirt-plugin.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T16:45:45Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "kubevirt" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false } }, "features": null, "logFormat": "text" }, "status": {} } 2026/02/05 16:45:50 DPA successfully reconciled STEP: Prepare backup resources, depending on the volumes backup type @ 02/05/26 16:45:50.499 2026/02/05 16:45:50 Snapclass 'example-snapclass' doesn't exist, creating 2026/02/05 16:45:50 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 16:45:50 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd STEP: Installing application for case ocp-kubevirt @ 02/05/26 16:45:50.619 2026/02/05 16:45:50 🔄 [Attempt 1/3] Executing operation: Deploy application ocp-kubevirt 2026/02/05 16:45:50 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11  30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11  40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18  49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}"  ^ column 18  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create resources] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml for localhost [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create namespace] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Deploy VM test-vm] *** changed: [localhost] FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (60 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (59 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (58 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (57 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (56 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (55 retries left). FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (54 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:44:11  42 --command "echo '{{ text_content }}' > {{ file_path }}" 43 environment: 44 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  FAILED - RETRYING: [localhost]: Run echo command on the VM (60 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Run echo command on the VM] *** changed: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:60:11  58 --command "cat {{ file_path }}" 59 environment: 60 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify file creation and content] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Display confirmation message] *** ok: [localhost] => {  "msg": "Text content written to '/home/fedora/test' on the VM 'test-vm' successfully." } TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Shutdown the VM if required] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM status to become 'Stopped'] *** ok: [localhost] PLAY RECAP ********************************************************************* localhost : ok=29  changed=9  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026/02/05 16:46:52 2026-02-05 16:45:52,338 p=30080 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:45:52,338 p=30080 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:45:52,659 p=30080 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:45:52,659 p=30080 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:45:52,982 p=30080 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:45:52,982 p=30080 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:45:53,304 p=30080 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:45:53,304 p=30080 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:45:53,323 p=30080 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:45:53,324 p=30080 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:45:53,324 p=30080 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:53,344 p=30080 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:45:53,344 p=30080 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:53,359 p=30080 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:45:53,359 p=30080 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:45:53,798 p=30080 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:45:53,799 p=30080 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:45:53,799 p=30080 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:45:53,799 p=30080 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:53,827 p=30080 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:45:53,827 p=30080 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:53,849 p=30080 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:45:53,849 p=30080 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:53,852 p=30080 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:45:54,483 p=30080 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:45:54,483 p=30080 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:54,727 p=30080 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** 2026-02-05 16:45:54,727 p=30080 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:54,978 p=30080 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** 2026-02-05 16:45:54,978 p=30080 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:55,364 p=30080 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** 2026-02-05 16:45:55,364 p=30080 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11 30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:45:55,364 p=30080 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:55,723 p=30080 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** 2026-02-05 16:45:55,724 p=30080 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11 40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:45:55,724 p=30080 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:55,748 p=30080 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** 2026-02-05 16:45:55,748 p=30080 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18 49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}" ^ column 18 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:45:55,748 p=30080 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:45:55,784 p=30080 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create resources] *** 2026-02-05 16:45:55,800 p=30080 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml for localhost 2026-02-05 16:45:56,949 p=30080 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Create namespace] *** 2026-02-05 16:45:56,950 p=30080 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:45:56,950 p=30080 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:45:56,950 p=30080 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:45:56,950 p=30080 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:45:56,951 p=30080 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:45:57,987 p=30080 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Deploy VM test-vm] *** 2026-02-05 16:45:57,987 p=30080 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:45:59,034 p=30080 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (60 retries left). 2026-02-05 16:46:04,912 p=30080 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (59 retries left). 2026-02-05 16:46:10,857 p=30080 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (58 retries left). 2026-02-05 16:46:16,753 p=30080 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (57 retries left). 2026-02-05 16:46:22,639 p=30080 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (56 retries left). 2026-02-05 16:46:28,563 p=30080 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (55 retries left). 2026-02-05 16:46:34,494 p=30080 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for VM to be Running & Ready (54 retries left). 2026-02-05 16:46:40,409 p=30080 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM to be Running & Ready] *** 2026-02-05 16:46:40,409 p=30080 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:46:43,896 p=30080 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Run echo command on the VM (60 retries left). 2026-02-05 16:46:50,144 p=30080 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Run echo command on the VM] *** 2026-02-05 16:46:50,145 p=30080 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:44:11 42 --command "echo '{{ text_content }}' > {{ file_path }}" 43 environment: 44 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:46:50,145 p=30080 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:46:50,744 p=30080 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify file creation and content] *** 2026-02-05 16:46:50,744 p=30080 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/deploy.yml:60:11 58 --command "cat {{ file_path }}" 59 environment: 60 PATH: "{{ ansible_env.HOME }}/.local/bin:{{ ansible_env.PATH }}" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:46:50,744 p=30080 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:46:50,761 p=30080 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Display confirmation message] *** 2026-02-05 16:46:50,762 p=30080 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Text content written to '/home/fedora/test' on the VM 'test-vm' successfully." } 2026-02-05 16:46:51,775 p=30080 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Shutdown the VM if required] *** 2026-02-05 16:46:51,776 p=30080 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:46:52,749 p=30080 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Wait for VM status to become 'Stopped'] *** 2026-02-05 16:46:52,750 p=30080 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:46:52,773 p=30080 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:46:52,773 p=30080 u=1001930000 n=ansible INFO| localhost : ok=29 changed=9 unreachable=0 failed=0 skipped=5 rescued=0 ignored=0 STEP: Verify Application deployment @ 02/05/26 16:46:52.834 2026/02/05 16:46:52 Using admin kubeconfig for with_validate operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11  30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11  40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18  49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}"  ^ column 18  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Validate migration] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml for localhost TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify VM is not in running state] *** [ERROR]: Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:11:10'. Conditionals must have a boolean result.  Task failed. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:1:3  1 - name: Verify VM is not in running state  ^ column 3  <<< caused by >>>  Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:11:10'. Conditionals must have a boolean result. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:11:10   9 verify_ssl: no 10 register: vm 11 until: vm.resources[0].status.conditions | selectattr('type', 'equalto', 'Ready') | selectattr('status', 'equalt...  ^ column 10  Broken conditionals can be temporarily allowed with the `ALLOW_BROKEN_CONDITIONALS` configuration option.  fatal: [localhost]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:11:10'. Conditionals must have a boolean result."} PLAY RECAP ********************************************************************* localhost : ok=21  changed=4  unreachable=0 failed=1  skipped=5  rescued=0 ignored=0 2026/02/05 16:46:59 2026-02-05 16:46:54,591 p=30618 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:46:54,591 p=30618 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:46:54,912 p=30618 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:46:54,912 p=30618 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:46:55,241 p=30618 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:46:55,241 p=30618 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:46:55,566 p=30618 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:46:55,567 p=30618 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:46:55,585 p=30618 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:46:55,585 p=30618 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:46:55,585 p=30618 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:46:55,606 p=30618 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:46:55,606 p=30618 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:46:55,621 p=30618 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:46:55,622 p=30618 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:46:56,054 p=30618 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:46:56,055 p=30618 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:46:56,055 p=30618 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:46:56,055 p=30618 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:46:56,085 p=30618 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:46:56,085 p=30618 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:46:56,108 p=30618 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:46:56,108 p=30618 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:46:56,111 p=30618 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:46:56,744 p=30618 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:46:56,744 p=30618 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:46:56,995 p=30618 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** 2026-02-05 16:46:56,995 p=30618 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:46:57,249 p=30618 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** 2026-02-05 16:46:57,250 p=30618 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:46:57,632 p=30618 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** 2026-02-05 16:46:57,633 p=30618 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11 30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:46:57,633 p=30618 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:46:58,005 p=30618 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** 2026-02-05 16:46:58,005 p=30618 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11 40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:46:58,005 p=30618 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:46:58,031 p=30618 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** 2026-02-05 16:46:58,031 p=30618 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18 49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}" ^ column 18 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:46:58,031 p=30618 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:46:58,088 p=30618 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Validate migration] *** 2026-02-05 16:46:58,101 p=30618 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml for localhost 2026-02-05 16:46:59,175 p=30618 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify VM is not in running state] *** 2026-02-05 16:46:59,175 p=30618 u=1001930000 n=ansible ERROR| [ERROR]: Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:11:10'. Conditionals must have a boolean result. Task failed. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:1:3 1 - name: Verify VM is not in running state ^ column 3 <<< caused by >>> Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:11:10'. Conditionals must have a boolean result. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:11:10 9 verify_ssl: no 10 register: vm 11 until: vm.resources[0].status.conditions | selectattr('type', 'equalto', 'Ready') | selectattr('status', 'equalt... ^ column 10 Broken conditionals can be temporarily allowed with the `ALLOW_BROKEN_CONDITIONALS` configuration option. 2026-02-05 16:46:59,176 p=30618 u=1001930000 n=ansible INFO| fatal: [localhost]: FAILED! => {"changed": false, "msg": "Task failed: Conditional result (True) was derived from value of type 'list' at '/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/validate.yml:11:10'. Conditionals must have a boolean result."} 2026-02-05 16:46:59,176 p=30618 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:46:59,176 p=30618 u=1001930000 n=ansible INFO| localhost : ok=21 changed=4 unreachable=0 failed=1 skipped=5 rescued=0 ignored=0 Run the command: oc get event -n test-oadp-186 2026/02/05 16:46:59 LAST SEEN TYPE REASON OBJECT MESSAGE 61s Warning FailedScheduling pod/importer-prime-7dfebd25-8f04-49ef-8cfb-7b8e7537e943 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 50s Warning FailedScheduling pod/importer-prime-7dfebd25-8f04-49ef-8cfb-7b8e7537e943 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 50s Normal Scheduled pod/importer-prime-7dfebd25-8f04-49ef-8cfb-7b8e7537e943 Successfully assigned test-oadp-186/importer-prime-7dfebd25-8f04-49ef-8cfb-7b8e7537e943 to ip-10-0-60-83.us-east-2.compute.internal 50s Normal SuccessfulAttachVolume pod/importer-prime-7dfebd25-8f04-49ef-8cfb-7b8e7537e943 AttachVolume.Attach succeeded for volume "pvc-8a9b2af3-a709-44d0-9539-f9643afc937d" 48s Normal SuccessfulMountVolume pod/importer-prime-7dfebd25-8f04-49ef-8cfb-7b8e7537e943 MapVolume.MapPodDevice succeeded for volume "pvc-8a9b2af3-a709-44d0-9539-f9643afc937d" globalMapPath "/var/lib/kubelet/plugins/kubernetes.io/csi/volumeDevices/pvc-8a9b2af3-a709-44d0-9539-f9643afc937d/dev" 48s Normal SuccessfulMountVolume pod/importer-prime-7dfebd25-8f04-49ef-8cfb-7b8e7537e943 MapVolume.MapPodDevice succeeded for volume "pvc-8a9b2af3-a709-44d0-9539-f9643afc937d" volumeMapPath "/var/lib/kubelet/pods/ad6e949e-b324-44c7-9fe8-becc91cf2be0/volumeDevices/kubernetes.io~csi" 48s Normal AddedInterface pod/importer-prime-7dfebd25-8f04-49ef-8cfb-7b8e7537e943 Add eth0 [10.129.2.125/23] from ovn-kubernetes 48s Normal Pulled pod/importer-prime-7dfebd25-8f04-49ef-8cfb-7b8e7537e943 Container image "registry.redhat.io/container-native-virtualization/virt-cdi-importer-rhel9@sha256:84d3534ff8027475d41f6dee3c827640905b98dc5251c6a31abad5c7d4cdb2dc" already present on machine 48s Normal Created pod/importer-prime-7dfebd25-8f04-49ef-8cfb-7b8e7537e943 Created container: init 48s Normal Started pod/importer-prime-7dfebd25-8f04-49ef-8cfb-7b8e7537e943 Started container init 48s Normal Pulled pod/importer-prime-7dfebd25-8f04-49ef-8cfb-7b8e7537e943 Container image "registry.redhat.io/container-native-virtualization/virt-cdi-importer-rhel9@sha256:84d3534ff8027475d41f6dee3c827640905b98dc5251c6a31abad5c7d4cdb2dc" already present on machine 48s Normal Created pod/importer-prime-7dfebd25-8f04-49ef-8cfb-7b8e7537e943 Created container: importer 48s Normal Started pod/importer-prime-7dfebd25-8f04-49ef-8cfb-7b8e7537e943 Started container importer 48s Normal Pulled pod/importer-prime-7dfebd25-8f04-49ef-8cfb-7b8e7537e943 Container image "quay.io/kubevirt/fedora-with-test-tooling-container-disk" already present on machine 48s Normal Created pod/importer-prime-7dfebd25-8f04-49ef-8cfb-7b8e7537e943 Created container: server 48s Normal Started pod/importer-prime-7dfebd25-8f04-49ef-8cfb-7b8e7537e943 Started container server 61s Warning ProvisioningFailed persistentvolumeclaim/prime-7dfebd25-8f04-49ef-8cfb-7b8e7537e943 Error saving claim: Operation cannot be fulfilled on persistentvolumeclaims "prime-7dfebd25-8f04-49ef-8cfb-7b8e7537e943": the object has been modified; please apply your changes to the latest version and try again 51s Normal ExternalProvisioning persistentvolumeclaim/prime-7dfebd25-8f04-49ef-8cfb-7b8e7537e943 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 51s Normal Provisioning persistentvolumeclaim/prime-7dfebd25-8f04-49ef-8cfb-7b8e7537e943 External provisioner is provisioning volume for claim "test-oadp-186/prime-7dfebd25-8f04-49ef-8cfb-7b8e7537e943" 51s Normal ProvisioningSucceeded persistentvolumeclaim/prime-7dfebd25-8f04-49ef-8cfb-7b8e7537e943 Successfully provisioned volume pvc-8a9b2af3-a709-44d0-9539-f9643afc937d 29s Normal ImportSucceeded persistentvolumeclaim/prime-7dfebd25-8f04-49ef-8cfb-7b8e7537e943 Import Successful 21s Warning ClaimMisbound persistentvolumeclaim/prime-7dfebd25-8f04-49ef-8cfb-7b8e7537e943 Two claims are bound to the same volume, this one is bound incorrectly 21s Warning UnrecognizedDataSourceKind persistentvolumeclaim/test-vm-dv The datasource for this PVC does not match any registered VolumePopulator 61s Normal CreatedPVCPrimeSuccessfully persistentvolumeclaim/test-vm-dv PVC Prime created successfully 61s Normal Pending datavolume/test-vm-dv PVC test-vm-dv Pending 61s Warning ProvisioningFailed persistentvolumeclaim/test-vm-dv Error saving claim: Operation cannot be fulfilled on persistentvolumeclaims "test-vm-dv": the object has been modified; please apply your changes to the latest version and try again 61s Warning Unschedulable datavolume/test-vm-dv Importer pod cannot be scheduled 29s Normal Provisioning persistentvolumeclaim/test-vm-dv External provisioner is provisioning volume for claim "test-oadp-186/test-vm-dv" 29s Normal Provisioning persistentvolumeclaim/test-vm-dv Assuming an external populator will provision the volume 29s Normal ExternalProvisioning persistentvolumeclaim/test-vm-dv Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 51s Normal ImportScheduled datavolume/test-vm-dv Import into test-vm-dv scheduled 47s Normal ImportInProgress datavolume/test-vm-dv Import into test-vm-dv in progress 31s Warning Completed datavolume/test-vm-dv Import Complete 29s Normal ImportSucceeded datavolume/test-vm-dv Successfully imported into PVC test-vm-dv 21s Normal importSucceeded persistentvolumeclaim/test-vm-dv Successfully imported into test-vm-dv 29s Normal Bound datavolume/test-vm-dv PVC test-vm-dv Bound 62s Normal SuccessfulDataVolumeCreate virtualmachine/test-vm Created DataVolume test-vm-dv 29s Normal SuccessfulCreate virtualmachine/test-vm Started the virtual machine by creating the new virtual machine instance test-vm 29s Normal SuccessfulCreate virtualmachineinstance/test-vm Created virtual machine pod virt-launcher-test-vm-qs874 25s Normal Created virtualmachineinstance/test-vm VirtualMachineInstance defined. 8s Warning Migrated virtualmachineinstance/test-vm EvictionStrategy is set but vmi is not migratable; cannot migrate VMI: PVC test-vm-dv is not shared, live migration requires that all PVCs must be shared (using ReadWriteMany access mode) 25s Normal Started virtualmachineinstance/test-vm VirtualMachineInstance started. 8s Normal SuccessfulDelete virtualmachine/test-vm Stopped the virtual machine by deleting the virtual machine instance 9d0dc479-3f99-4981-abbf-a44f55795174 4s Normal SuccessfulDelete virtualmachineinstance/test-vm Deleted virtual machine pod virt-launcher-test-vm-qs874 8s Normal Deleted virtualmachineinstance/test-vm VirtualMachineInstance stopping 8s Normal Deleted virtualmachineinstance/test-vm Signaled Deletion 8s Normal Stopped virtualmachineinstance/test-vm The VirtualMachineInstance was shut down. 28s Normal Scheduled pod/virt-launcher-test-vm-qs874 Successfully assigned test-oadp-186/virt-launcher-test-vm-qs874 to ip-10-0-60-83.us-east-2.compute.internal 29s Normal SuccessfulMountVolume pod/virt-launcher-test-vm-qs874 MapVolume.MapPodDevice succeeded for volume "pvc-8a9b2af3-a709-44d0-9539-f9643afc937d" globalMapPath "/var/lib/kubelet/plugins/kubernetes.io/csi/volumeDevices/pvc-8a9b2af3-a709-44d0-9539-f9643afc937d/dev" 29s Normal SuccessfulMountVolume pod/virt-launcher-test-vm-qs874 MapVolume.MapPodDevice succeeded for volume "pvc-8a9b2af3-a709-44d0-9539-f9643afc937d" volumeMapPath "/var/lib/kubelet/pods/04f04ca5-db07-4cec-b40d-08a02e3cb40d/volumeDevices/kubernetes.io~csi" 28s Normal AddedInterface pod/virt-launcher-test-vm-qs874 Add eth0 [10.129.2.126/23] from ovn-kubernetes 28s Normal Pulled pod/virt-launcher-test-vm-qs874 Container image "registry.redhat.io/container-native-virtualization/virt-launcher-rhel9@sha256:3138ad3a4471ca69be37fbe50a96be4b89e120de0e2808067ca99ff576f16256" already present on machine 28s Normal Created pod/virt-launcher-test-vm-qs874 Created container: guest-console-log 28s Normal Started pod/virt-launcher-test-vm-qs874 Started container guest-console-log 27s Normal Pulled pod/virt-launcher-test-vm-qs874 Container image "registry.redhat.io/container-native-virtualization/virt-launcher-rhel9@sha256:3138ad3a4471ca69be37fbe50a96be4b89e120de0e2808067ca99ff576f16256" already present on machine 27s Normal Created pod/virt-launcher-test-vm-qs874 Created container: compute 27s Normal Started pod/virt-launcher-test-vm-qs874 Started container compute 8s Normal Killing pod/virt-launcher-test-vm-qs874 Stopping container guest-console-log 8s Normal Killing pod/virt-launcher-test-vm-qs874 Stopping container compute [FAILED] in [It] - /alabama/cspi/test_common/backup_restore_app_case.go:52 @ 02/05/26 16:46:59.364 < Exit [It] [tc-id:OADP-186] [kubevirt] [Tier0] [vf:vm] Stopped VM should be restored @ 02/05/26 16:46:59.364 (1m13.972s) > Enter [JustAfterEach] TOP-LEVEL @ 02/05/26 16:46:59.364 2026/02/05 16:46:59 Using Must-gather image: registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 STEP: Get the failed spec name @ 02/05/26 16:46:59.364 2026/02/05 16:46:59 The failed spec name is: CSI: Backup/Restore Openshift Virtualization Workloads [tc-id:OADP-186] [kubevirt] [Tier0] [vf:vm] Stopped VM should be restored STEP: Create a folder for all must-gather files if it doesn't exists already @ 02/05/26 16:46:59.364 STEP: Create a folder for the failed spec if it doesn't exists already @ 02/05/26 16:46:59.364 STEP: Run must-gather because the spec failed @ 02/05/26 16:46:59.364 2026/02/05 16:46:59 Log the present working directory path:- /alabama/cspi/e2e/kubevirt-plugin 2026/02/05 16:46:59 [adm must-gather --dest-dir /alabama/cspi/e2e/kubevirt-plugin/logs/It_CSI_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-186_kubevirt_Tier0_vf_vm_Stopped_VM_should_be_restored --image registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3] 2026/02/05 16:47:10 Log all the files present in /alabama/cspi/e2e/kubevirt-plugin/logs directory 2026/02/05 16:47:10 It_CSI_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-185_kubevirt_Tier0_vf_vm_Backing_up_started_VM_should_succeed 2026/02/05 16:47:10 It_CSI_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-186_kubevirt_Tier0_vf_vm_Stopped_VM_should_be_restored 2026/02/05 16:47:10 It_Native_CSI_Data_Mover_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-401_kubevirt_Tier1_Started_VM_should_over_ceph_filesytem_mode STEP: Find must-gather folder and rename it to a shorter more readable name @ 02/05/26 16:47:10.286 The folder logs/It_CSI_Backup_Restore_Openshift_Virtualization_Workloads_tc-id_OADP-186_kubevirt_Tier0_vf_vm_Stopped_VM_should_be_restored/must-gather already exists, skipping renaming the folder < Exit [JustAfterEach] TOP-LEVEL @ 02/05/26 16:47:10.286 (10.922s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:47:10.286 2026/02/05 16:47:10 Cleaning app 2026/02/05 16:47:10 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11  30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11  40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc"  ^ column 11  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** ok: [localhost] [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18  49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}"  ^ column 18  Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead.  TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Cleanup resources] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/cleanup.yml for localhost [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-186] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=22  changed=5  unreachable=0 failed=0 skipped=6  rescued=0 ignored=0 2026/02/05 16:47:31 2026-02-05 16:47:11,990 p=30956 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:47:11,990 p=30956 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:47:12,324 p=30956 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:47:12,324 p=30956 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:47:12,651 p=30956 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:47:12,651 p=30956 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:47:12,980 p=30956 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:47:12,981 p=30956 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:47:12,998 p=30956 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:47:12,999 p=30956 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:47:12,999 p=30956 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:47:13,018 p=30956 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:47:13,018 p=30956 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:47:13,033 p=30956 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:47:13,033 p=30956 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:47:13,458 p=30956 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:47:13,459 p=30956 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:47:13,459 p=30956 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:47:13,459 p=30956 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:47:13,488 p=30956 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:47:13,488 p=30956 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:47:13,509 p=30956 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:47:13,509 p=30956 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:47:13,512 p=30956 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:47:14,138 p=30956 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:47:14,138 p=30956 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:47:14,397 p=30956 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure sshpass is installed] *** 2026-02-05 16:47:14,398 p=30956 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:47:14,652 p=30956 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure virtctl is installed] *** 2026-02-05 16:47:14,652 p=30956 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:47:15,032 p=30956 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Verify sshpass installation] *** 2026-02-05 16:47:15,033 p=30956 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:32:11 30 - name: Verify sshpass installation 31 ansible.builtin.stat: 32 path: "{{ ansible_env.HOME }}/.local/bin/sshpass" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:47:15,033 p=30956 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:47:15,408 p=30956 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Ensure ~/.local/bin is in the user's PATH] *** 2026-02-05 16:47:15,408 p=30956 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:42:11 40 - name: Ensure ~/.local/bin is in the user's PATH 41 ansible.builtin.lineinfile: 42 path: "{{ ansible_env.HOME }}/.bashrc" ^ column 11 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:47:15,408 p=30956 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:47:15,433 p=30956 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Set PATH environment variable for current session] *** 2026-02-05 16:47:15,433 p=30956 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: INJECT_FACTS_AS_VARS default to `True` is deprecated, top-level facts will not be auto injected after the change. This feature will be removed from ansible-core version 2.24. Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/main.yml:51:18 49 - name: Set PATH environment variable for current session 50 ansible.builtin.set_fact: 51 ansible_env: "{{ ansible_env | combine({'PATH': ansible_env.HOME + '/.local/bin:' + ansible_env.PATH}) }}" ^ column 18 Use `ansible_facts["fact_name"]` (no `ansible_` prefix) instead. 2026-02-05 16:47:15,434 p=30956 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:47:15,453 p=30956 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Cleanup resources] *** 2026-02-05 16:47:15,463 p=30956 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt/tasks/cleanup.yml for localhost 2026-02-05 16:47:31,650 p=30956 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt : Remove namespace test-oadp-186] *** 2026-02-05 16:47:31,651 p=30956 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:47:31,651 p=30956 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:47:31,651 p=30956 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:47:31,652 p=30956 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:47:31,652 p=30956 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:47:31,713 p=30956 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:47:31,713 p=30956 u=1001930000 n=ansible INFO| localhost : ok=22 changed=5 unreachable=0 failed=0 skipped=6 rescued=0 ignored=0 < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:47:31.772 (21.486s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:47:31.772 2026/02/05 16:47:31 Cleaning setup resources for the backup 2026/02/05 16:47:31 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 16:47:31 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2026/02/05 16:47:31 Deleting VolumeSnapshotClass 'example-snapclass' < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:47:31.809 (37ms) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:47:31.809 2026/02/05 16:47:31 Deleting DPA CR < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:47:31.821 (12ms) • [FAILED] [375.709 seconds] CSI: Backup/Restore Openshift Virtualization Workloads  [It] [tc-id:OADP-186] [kubevirt] [Tier0] [vf:vm] Stopped VM should be restored /alabama/cspi/e2e/kubevirt-plugin/backup_restore_csi.go:51 [FAILED] Unexpected error: <*errors.Error | 0xc000a46000>: Error during command execution: ansible-playbook error: one or more host failed Command executed: /usr/local/bin/ansible-playbook --extra-vars {"admin_kubeconfig":"/home/jenkins/.kube/config","namespace":"test-oadp-186","non_admin_user":false,"use_role":"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt","user_kubeconfig":"/home/jenkins/.kube/config","vm_running":false,"with_validate":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml exit status 2 { context: "(DefaultExecute::Execute)", message: "Error during command execution: ansible-playbook error: one or more host failed\n\nCommand executed: /usr/local/bin/ansible-playbook --extra-vars {\"admin_kubeconfig\":\"/home/jenkins/.kube/config\",\"namespace\":\"test-oadp-186\",\"non_admin_user\":false,\"use_role\":\"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-kubevirt\",\"user_kubeconfig\":\"/home/jenkins/.kube/config\",\"vm_running\":false,\"with_validate\":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml\n\nexit status 2", wrappedErrors: nil, } occurred In [It] at: /alabama/cspi/test_common/backup_restore_app_case.go:52 @ 02/05/26 16:46:59.364 There were additional failures detected. To view them in detail run ginkgo -vv ------------------------------ CSI: Backup/Restore Openshift Virtualization Workloads  [tc-id:OADP-187] [kubevirt] [Tier0] [vf:vm] Backup-restore data volume /alabama/cspi/e2e/kubevirt-plugin/backup_restore_csi.go:68 > Enter [BeforeEach] CSI: Backup/Restore Openshift Virtualization Workloads @ 02/05/26 16:47:31.821 < Exit [BeforeEach] CSI: Backup/Restore Openshift Virtualization Workloads @ 02/05/26 16:47:31.839 (18ms) > Enter [JustBeforeEach] TOP-LEVEL @ 02/05/26 16:47:31.839 < Exit [JustBeforeEach] TOP-LEVEL @ 02/05/26 16:47:31.84 (0s) > Enter [It] [tc-id:OADP-187] [kubevirt] [Tier0] [vf:vm] Backup-restore data volume @ 02/05/26 16:47:31.84 2026/02/05 16:47:31 Delete all downloadrequest No download requests are found STEP: Create DPA CR @ 02/05/26 16:47:31.845 2026/02/05 16:47:31 csi 2026/02/05 16:47:31 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "c8726afa-a9b8-4b75-b6cc-f3d769c0f1e4", "resourceVersion": "92108", "generation": 1, "creationTimestamp": "2026-02-05T16:47:31Z", "managedFields": [ { "manager": "kubevirt-plugin.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T16:47:31Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "kubevirt" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false } }, "features": null, "logFormat": "text" }, "status": {} } Delete all the backups that remained in the phase InProgress Deleting backup CRs in progress Deletion of backup CRs in progress completed Delete all the restores that remained in the phase InProgress Deleting restore CRs in progress Deletion of restore CRs in progress completed STEP: Verify DPA CR setup @ 02/05/26 16:47:31.921 2026/02/05 16:47:31 Waiting for velero pod to be running 2026/02/05 16:47:31 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete' 2026/02/05 16:47:31 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "c8726afa-a9b8-4b75-b6cc-f3d769c0f1e4", "resourceVersion": "92108", "generation": 1, "creationTimestamp": "2026-02-05T16:47:31Z", "managedFields": [ { "manager": "kubevirt-plugin.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T16:47:31Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "kubevirt" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false } }, "features": null, "logFormat": "text" }, "status": {} } 2026/02/05 16:47:36 DPA successfully reconciled STEP: Prepare backup resources, depending on the volumes backup type @ 02/05/26 16:47:36.958 Run the command: oc get ns openshift-storage &> /dev/null && echo true || echo false 2026/02/05 16:47:37 The 'openshift-storage' namespace exists 2026/02/05 16:47:37 Checking default storage class count 2026/02/05 16:47:37 Using the CSI driver: openshift-storage.rbd.csi.ceph.com 2026/02/05 16:47:37 Snapclass 'example-snapclass' doesn't exist, creating 2026/02/05 16:47:37 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 16:47:37 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd STEP: Installing application for case ocp-datavolume @ 02/05/26 16:47:37.245 2026/02/05 16:47:37 🔄 [Attempt 1/3] Executing operation: Deploy application ocp-datavolume 2026/02/05 16:47:37 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-datavolume : Create namespace] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-datavolume : Deploy DataVolume test-dv] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=17  changed=6  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026/02/05 16:47:43 2026-02-05 16:47:39,105 p=31252 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:47:39,105 p=31252 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:47:39,459 p=31252 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:47:39,459 p=31252 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:47:39,804 p=31252 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:47:39,805 p=31252 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:47:40,155 p=31252 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:47:40,155 p=31252 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:47:40,173 p=31252 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:47:40,174 p=31252 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:47:40,174 p=31252 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:47:40,194 p=31252 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:47:40,194 p=31252 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:47:40,209 p=31252 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:47:40,209 p=31252 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:47:40,631 p=31252 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:47:40,632 p=31252 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:47:40,632 p=31252 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:47:40,632 p=31252 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:47:40,661 p=31252 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:47:40,661 p=31252 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:47:40,682 p=31252 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:47:40,682 p=31252 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:47:40,685 p=31252 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:47:41,317 p=31252 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:47:41,317 p=31252 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:47:42,591 p=31252 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-datavolume : Create namespace] *** 2026-02-05 16:47:42,592 p=31252 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:47:42,592 p=31252 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:47:42,593 p=31252 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:47:42,593 p=31252 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:47:42,593 p=31252 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:47:43,712 p=31252 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-datavolume : Deploy DataVolume test-dv] *** 2026-02-05 16:47:43,713 p=31252 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:47:43,761 p=31252 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:47:43,762 p=31252 u=1001930000 n=ansible INFO| localhost : ok=17 changed=6 unreachable=0 failed=0 skipped=4 rescued=0 ignored=0 STEP: Verify Application deployment @ 02/05/26 16:47:43.827 2026/02/05 16:47:43 Using admin kubeconfig for with_validate operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. FAILED - RETRYING: [localhost]: Wait for DataVolume to be in Succeeded phase (30 retries left). FAILED - RETRYING: [localhost]: Wait for DataVolume to be in Succeeded phase (29 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-datavolume : Wait for DataVolume to be in Succeeded phase] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-datavolume : Wait until there is only one pvc] *** ok: [localhost] PLAY RECAP ********************************************************************* localhost : ok=17  changed=4  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026/02/05 16:48:11 2026-02-05 16:47:45,651 p=31478 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:47:45,651 p=31478 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:47:45,979 p=31478 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:47:45,979 p=31478 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:47:46,320 p=31478 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:47:46,321 p=31478 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:47:46,660 p=31478 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:47:46,660 p=31478 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:47:46,679 p=31478 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:47:46,680 p=31478 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:47:46,680 p=31478 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:47:46,699 p=31478 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:47:46,699 p=31478 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:47:46,714 p=31478 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:47:46,714 p=31478 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:47:47,141 p=31478 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:47:47,142 p=31478 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:47:47,142 p=31478 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:47:47,142 p=31478 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:47:47,169 p=31478 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:47:47,169 p=31478 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:47:47,192 p=31478 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:47:47,193 p=31478 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:47:47,195 p=31478 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:47:47,801 p=31478 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:47:47,802 p=31478 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:47:48,973 p=31478 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for DataVolume to be in Succeeded phase (30 retries left). 2026-02-05 16:48:00,010 p=31478 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for DataVolume to be in Succeeded phase (29 retries left). 2026-02-05 16:48:10,919 p=31478 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-datavolume : Wait for DataVolume to be in Succeeded phase] *** 2026-02-05 16:48:10,919 p=31478 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:48:10,920 p=31478 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:48:10,920 p=31478 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:48:10,920 p=31478 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:48:10,920 p=31478 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:48:11,849 p=31478 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-datavolume : Wait until there is only one pvc] *** 2026-02-05 16:48:11,850 p=31478 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:48:11,854 p=31478 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:48:11,854 p=31478 u=1001930000 n=ansible INFO| localhost : ok=17 changed=4 unreachable=0 failed=0 skipped=4 rescued=0 ignored=0 2026/02/05 16:48:11 {{ } { } [{{ } {test-dv test-oadp-187 a701d3ef-0291-4d2e-ab05-941ca8aecb19 92882 0 2026-02-05 16:47:43 +0000 UTC map[alerts.k8s.io/KubePersistentVolumeFillingUp:disabled app:containerized-data-importer app.kubernetes.io/component:storage app.kubernetes.io/managed-by:cdi-controller app.kubernetes.io/part-of:hyperconverged-cluster app.kubernetes.io/version:4.20.3] map[cdi.kubevirt.io/createdForDataVolume:d50b867c-fb12-4ff6-8f83-84a2737fa5d4 cdi.kubevirt.io/storage.bind.immediate.requested:true cdi.kubevirt.io/storage.condition.running:false cdi.kubevirt.io/storage.condition.running.message:Import Complete cdi.kubevirt.io/storage.condition.running.reason:Completed cdi.kubevirt.io/storage.contentType:kubevirt cdi.kubevirt.io/storage.deleteAfterCompletion:false cdi.kubevirt.io/storage.pod.phase:Succeeded cdi.kubevirt.io/storage.pod.restarts:0 cdi.kubevirt.io/storage.pod.schedulable:true cdi.kubevirt.io/storage.populator.progress:100.0% cdi.kubevirt.io/storage.preallocation.requested:false cdi.kubevirt.io/storage.usePopulator:true pv.kubernetes.io/bind-completed:yes pv.kubernetes.io/bound-by-controller:yes volume.beta.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com volume.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com] [{cdi.kubevirt.io/v1beta1 DataVolume test-dv d50b867c-fb12-4ff6-8f83-84a2737fa5d4 0xc000d5cb47 0xc000d5cb48}] [kubernetes.io/pvc-protection] [{kube-controller-manager Update v1 2026-02-05 16:48:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:pv.kubernetes.io/bind-completed":{},"f:pv.kubernetes.io/bound-by-controller":{},"f:volume.beta.kubernetes.io/storage-provisioner":{},"f:volume.kubernetes.io/storage-provisioner":{}}},"f:spec":{"f:volumeName":{}}} } {kube-controller-manager Update v1 2026-02-05 16:48:07 +0000 UTC FieldsV1 {"f:status":{"f:accessModes":{},"f:capacity":{".":{},"f:storage":{}},"f:phase":{}}} status} {virt-cdi-controller Update v1 2026-02-05 16:48:07 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:cdi.kubevirt.io/createdForDataVolume":{},"f:cdi.kubevirt.io/storage.bind.immediate.requested":{},"f:cdi.kubevirt.io/storage.condition.running":{},"f:cdi.kubevirt.io/storage.condition.running.message":{},"f:cdi.kubevirt.io/storage.condition.running.reason":{},"f:cdi.kubevirt.io/storage.contentType":{},"f:cdi.kubevirt.io/storage.deleteAfterCompletion":{},"f:cdi.kubevirt.io/storage.pod.phase":{},"f:cdi.kubevirt.io/storage.pod.restarts":{},"f:cdi.kubevirt.io/storage.pod.schedulable":{},"f:cdi.kubevirt.io/storage.populator.progress":{},"f:cdi.kubevirt.io/storage.preallocation.requested":{},"f:cdi.kubevirt.io/storage.usePopulator":{}},"f:labels":{".":{},"f:alerts.k8s.io/KubePersistentVolumeFillingUp":{},"f:app":{},"f:app.kubernetes.io/component":{},"f:app.kubernetes.io/managed-by":{},"f:app.kubernetes.io/part-of":{},"f:app.kubernetes.io/version":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"d50b867c-fb12-4ff6-8f83-84a2737fa5d4\"}":{}}},"f:spec":{"f:accessModes":{},"f:dataSourceRef":{".":{},"f:apiGroup":{},"f:kind":{},"f:name":{}},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}} }]} {[ReadWriteOnce] nil {map[] map[storage:{{104857600 0} {} 100Mi BinarySI}]} pvc-bdd9d048-dc6e-4bfd-baf9-cfd09fa885f0 0xc000d007a0 0xc000d007b0 &TypedLocalObjectReference{APIGroup:*cdi.kubevirt.io,Kind:VolumeImportSource,Name:volume-import-source-d50b867c-fb12-4ff6-8f83-84a2737fa5d4,} &TypedObjectReference{APIGroup:*cdi.kubevirt.io,Kind:VolumeImportSource,Name:volume-import-source-d50b867c-fb12-4ff6-8f83-84a2737fa5d4,Namespace:nil,} } {Bound [ReadWriteOnce] map[storage:{{104857600 0} {} 100Mi BinarySI}] [] map[] map[] nil}}]} STEP: Creating backup ocp-datavolume-5d53c5a8-02b2-11f1-a828-0a58ac1896e8 @ 02/05/26 16:48:11.922 2026/02/05 16:48:11 Wait until backup ocp-datavolume-5d53c5a8-02b2-11f1-a828-0a58ac1896e8 is completed backup phase: Completed 2026/02/05 16:48:31 Verify the Backup has CSIVolumeSnapshotsAttempted and CSIVolumeSnapshotsCompleted field on status 2026/02/05 16:48:32 Run velero describe on the backup 2026/02/05 16:48:32 [./velero describe backup ocp-datavolume-5d53c5a8-02b2-11f1-a828-0a58ac1896e8 -n openshift-adp --details --insecure-skip-tls-verify] 2026/02/05 16:48:32 Exec stderr: "" 2026/02/05 16:48:32 Name: ocp-datavolume-5d53c5a8-02b2-11f1-a828-0a58ac1896e8 Namespace: openshift-adp Labels: velero.io/storage-location=ts-dpa-1 Annotations: velero.io/resource-timeout=10m0s velero.io/source-cluster-k8s-gitversion=v1.34.2 velero.io/source-cluster-k8s-major-version=1 velero.io/source-cluster-k8s-minor-version=34 Phase: Completed Namespaces: Included: test-oadp-187 Excluded: Resources: Included: * Excluded: Cluster-scoped: auto Label selector: Or label selector: Storage Location: ts-dpa-1 Velero-Native Snapshot PVs: auto File System Backup (Default): false Snapshot Move Data: false Data Mover: velero TTL: 720h0m0s CSISnapshotTimeout: 10m0s ItemOperationTimeout: 4h0m0s Hooks: Backup Format Version: 1.1.0 Started: 2026-02-05 16:48:12 +0000 UTC Completed: 2026-02-05 16:48:20 +0000 UTC Expiration: 2026-03-07 16:48:11 +0000 UTC Total items to be backed up: 48 Items backed up: 48 Backup Item Operations: Operation for volumesnapshots.snapshot.storage.k8s.io test-oadp-187/velero-test-dv-5npbq: Backup Item Action Plugin: velero.io/csi-volumesnapshot-backupper Operation ID: test-oadp-187/velero-test-dv-5npbq/2026-02-05T16:48:18Z Items to Update: volumesnapshots.snapshot.storage.k8s.io test-oadp-187/velero-test-dv-5npbq volumesnapshotcontents.snapshot.storage.k8s.io /snapcontent-03b13cdb-fdf4-4c43-af88-b628bb2bafa1 Phase: Completed Created: 2026-02-05 16:48:18 +0000 UTC Started: 2026-02-05 16:48:18 +0000 UTC Updated: 2026-02-05 16:48:19 +0000 UTC Resource List: apiextensions.k8s.io/v1/CustomResourceDefinition: - datavolumes.cdi.kubevirt.io authorization.openshift.io/v1/RoleBinding: - test-oadp-187/system:deployers - test-oadp-187/system:image-builders - test-oadp-187/system:image-pullers cdi.kubevirt.io/v1beta1/DataVolume: - test-oadp-187/test-dv rbac.authorization.k8s.io/v1/RoleBinding: - test-oadp-187/system:deployers - test-oadp-187/system:image-builders - test-oadp-187/system:image-pullers snapshot.storage.k8s.io/v1/VolumeSnapshot: - test-oadp-187/velero-test-dv-5npbq snapshot.storage.k8s.io/v1/VolumeSnapshotClass: - example-snapclass snapshot.storage.k8s.io/v1/VolumeSnapshotContent: - snapcontent-03b13cdb-fdf4-4c43-af88-b628bb2bafa1 v1/ConfigMap: - test-oadp-187/kube-root-ca.crt - test-oadp-187/openshift-service-ca.crt v1/Event: - test-oadp-187/importer-prime-a701d3ef-0291-4d2e-ab05-941ca8aecb19.1891679f96ddfcf6 - test-oadp-187/importer-prime-a701d3ef-0291-4d2e-ab05-941ca8aecb19.1891679f98dbc0bd - test-oadp-187/importer-prime-a701d3ef-0291-4d2e-ab05-941ca8aecb19.189167a1f5fc184b - test-oadp-187/importer-prime-a701d3ef-0291-4d2e-ab05-941ca8aecb19.189167a21be0fc49 - test-oadp-187/importer-prime-a701d3ef-0291-4d2e-ab05-941ca8aecb19.189167a48dd717b6 - test-oadp-187/importer-prime-a701d3ef-0291-4d2e-ab05-941ca8aecb19.189167a4907dfeab - test-oadp-187/importer-prime-a701d3ef-0291-4d2e-ab05-941ca8aecb19.189167a4957ed254 - test-oadp-187/importer-prime-a701d3ef-0291-4d2e-ab05-941ca8aecb19.189167a495fb655c - test-oadp-187/prime-a701d3ef-0291-4d2e-ab05-941ca8aecb19.1891679f9597a198 - test-oadp-187/prime-a701d3ef-0291-4d2e-ab05-941ca8aecb19.189167a1df8af67a - test-oadp-187/prime-a701d3ef-0291-4d2e-ab05-941ca8aecb19.189167a1df8b0bc4 - test-oadp-187/prime-a701d3ef-0291-4d2e-ab05-941ca8aecb19.189167a1f4920dbe - test-oadp-187/prime-a701d3ef-0291-4d2e-ab05-941ca8aecb19.189167a50773c26a - test-oadp-187/prime-a701d3ef-0291-4d2e-ab05-941ca8aecb19.189167a55d99c7b5 - test-oadp-187/test-dv.1891679f9488f68f - test-oadp-187/test-dv.1891679f94e22b44 - test-oadp-187/test-dv.1891679f94ea0526 - test-oadp-187/test-dv.1891679f95338813 - test-oadp-187/test-dv.1891679f9537f14c - test-oadp-187/test-dv.1891679f95384019 - test-oadp-187/test-dv.1891679f95e9410f - test-oadp-187/test-dv.189167a1f774b05d - test-oadp-187/test-dv.189167a4c24ec1e1 - test-oadp-187/test-dv.189167a508920c00 - test-oadp-187/test-dv.189167a508e8f6bc - test-oadp-187/test-dv.189167a50a764ee0 v1/Namespace: - test-oadp-187 v1/PersistentVolume: - pvc-bdd9d048-dc6e-4bfd-baf9-cfd09fa885f0 v1/PersistentVolumeClaim: - test-oadp-187/test-dv v1/Secret: - test-oadp-187/builder-dockercfg-lk2q9 - test-oadp-187/default-dockercfg-xhpmb - test-oadp-187/deployer-dockercfg-4pq74 v1/ServiceAccount: - test-oadp-187/builder - test-oadp-187/default - test-oadp-187/deployer Backup Volumes: Velero-Native Snapshots: CSI Snapshots: test-oadp-187/test-dv: Snapshot: Operation ID: test-oadp-187/velero-test-dv-5npbq/2026-02-05T16:48:18Z Snapshot Content Name: snapcontent-03b13cdb-fdf4-4c43-af88-b628bb2bafa1 Storage Snapshot ID: 0001-0011-openshift-storage-0000000000000003-73e2bf17-895e-4397-bfda-c07d7d37661f Snapshot Size (bytes): 104857600 CSI Driver: openshift-storage.rbd.csi.ceph.com Result: succeeded Pod Volume Backups: HooksAttempted: 0 HooksFailed: 0 STEP: Verify backup ocp-datavolume-5d53c5a8-02b2-11f1-a828-0a58ac1896e8 has completed successfully @ 02/05/26 16:48:32.526 2026/02/05 16:48:32 Backup for case ocp-datavolume succeeded STEP: Delete the appplication resources ocp-datavolume @ 02/05/26 16:48:32.575 STEP: Cleanup Application for case ocp-datavolume @ 02/05/26 16:48:32.575 2026/02/05 16:48:32 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-datavolume : Remove namespace test-oadp-187] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=16  changed=5  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026/02/05 16:48:53 2026-02-05 16:48:34,354 p=31731 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:48:34,355 p=31731 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:48:34,713 p=31731 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:48:34,713 p=31731 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:48:35,059 p=31731 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:48:35,059 p=31731 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:48:35,389 p=31731 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:48:35,390 p=31731 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:48:35,407 p=31731 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:48:35,408 p=31731 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:48:35,408 p=31731 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:48:35,428 p=31731 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:48:35,428 p=31731 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:48:35,442 p=31731 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:48:35,443 p=31731 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:48:35,880 p=31731 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:48:35,880 p=31731 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:48:35,880 p=31731 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:48:35,880 p=31731 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:48:35,909 p=31731 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:48:35,909 p=31731 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:48:35,930 p=31731 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:48:35,930 p=31731 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:48:35,933 p=31731 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:48:36,564 p=31731 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:48:36,564 p=31731 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:48:52,966 p=31731 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-datavolume : Remove namespace test-oadp-187] *** 2026-02-05 16:48:52,967 p=31731 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:48:52,967 p=31731 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:48:52,968 p=31731 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:48:52,968 p=31731 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:48:52,968 p=31731 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:48:53,166 p=31731 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:48:53,166 p=31731 u=1001930000 n=ansible INFO| localhost : ok=16 changed=5 unreachable=0 failed=0 skipped=5 rescued=0 ignored=0 2026/02/05 16:48:53 Creating restore ocp-datavolume-5d53c5a8-02b2-11f1-a828-0a58ac1896e8 for case ocp-datavolume-5d53c5a8-02b2-11f1-a828-0a58ac1896e8 STEP: Create restore ocp-datavolume-5d53c5a8-02b2-11f1-a828-0a58ac1896e8 from backup ocp-datavolume-5d53c5a8-02b2-11f1-a828-0a58ac1896e8 @ 02/05/26 16:48:53.327 2026/02/05 16:48:53 Wait until restore ocp-datavolume-5d53c5a8-02b2-11f1-a828-0a58ac1896e8 is complete restore phase: Finalizing restore phase: Completed STEP: Verify restore ocp-datavolume-5d53c5a8-02b2-11f1-a828-0a58ac1896e8has completed successfully @ 02/05/26 16:49:13.434 STEP: Verify Application restore @ 02/05/26 16:49:13.441 STEP: Verify Application deployment for case ocp-datavolume @ 02/05/26 16:49:13.441 2026/02/05 16:49:13 Using admin kubeconfig for with_validate operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-datavolume : Wait for DataVolume to be in Succeeded phase] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-datavolume : Wait until there is only one pvc] *** ok: [localhost] PLAY RECAP ********************************************************************* localhost : ok=17  changed=4  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026/02/05 16:49:22 2026-02-05 16:49:15,902 p=31944 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:49:15,903 p=31944 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:49:16,397 p=31944 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:49:16,397 p=31944 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:49:16,885 p=31944 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:49:16,885 p=31944 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:49:17,569 p=31944 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:49:17,569 p=31944 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:49:17,601 p=31944 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:49:17,602 p=31944 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:49:17,602 p=31944 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:49:17,639 p=31944 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:49:17,639 p=31944 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:49:17,668 p=31944 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:49:17,669 p=31944 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:49:18,363 p=31944 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:49:18,364 p=31944 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:49:18,364 p=31944 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:49:18,364 p=31944 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:49:18,413 p=31944 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:49:18,413 p=31944 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:49:18,449 p=31944 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:49:18,449 p=31944 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:49:18,454 p=31944 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:49:19,400 p=31944 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:49:19,400 p=31944 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:49:21,276 p=31944 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-datavolume : Wait for DataVolume to be in Succeeded phase] *** 2026-02-05 16:49:21,277 p=31944 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:49:21,277 p=31944 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:49:21,278 p=31944 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:49:21,278 p=31944 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:49:21,278 p=31944 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:49:22,739 p=31944 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-datavolume : Wait until there is only one pvc] *** 2026-02-05 16:49:22,740 p=31944 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:49:22,748 p=31944 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:49:22,748 p=31944 u=1001930000 n=ansible INFO| localhost : ok=17 changed=4 unreachable=0 failed=0 skipped=4 rescued=0 ignored=0 < Exit [It] [tc-id:OADP-187] [kubevirt] [Tier0] [vf:vm] Backup-restore data volume @ 02/05/26 16:49:22.901 (1m51.062s) > Enter [JustAfterEach] TOP-LEVEL @ 02/05/26 16:49:22.901 2026/02/05 16:49:22 Using Must-gather image: registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 < Exit [JustAfterEach] TOP-LEVEL @ 02/05/26 16:49:22.901 (0s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:49:22.901 < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:49:22.907 (6ms) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:49:22.907 < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:49:22.907 (0s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:49:22.907 2026/02/05 16:49:22 Cleaning app 2026/02/05 16:49:22 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-datavolume : Remove namespace test-oadp-187] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=16  changed=5  unreachable=0 failed=0 skipped=5  rescued=0 ignored=0 2026/02/05 16:49:44 2026-02-05 16:49:25,806 p=32148 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:49:25,806 p=32148 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:49:26,328 p=32148 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:49:26,328 p=32148 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:49:26,726 p=32148 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:49:26,726 p=32148 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:49:27,109 p=32148 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:49:27,109 p=32148 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:49:27,130 p=32148 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:49:27,131 p=32148 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:49:27,131 p=32148 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:49:27,159 p=32148 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:49:27,159 p=32148 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:49:27,175 p=32148 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:49:27,176 p=32148 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:49:27,646 p=32148 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:49:27,647 p=32148 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:49:27,647 p=32148 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:49:27,647 p=32148 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:49:27,676 p=32148 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:49:27,676 p=32148 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:49:27,700 p=32148 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:49:27,700 p=32148 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:49:27,704 p=32148 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:49:28,403 p=32148 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:49:28,403 p=32148 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:49:44,756 p=32148 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-datavolume : Remove namespace test-oadp-187] *** 2026-02-05 16:49:44,756 p=32148 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:49:44,756 p=32148 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:49:44,757 p=32148 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:49:44,757 p=32148 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:49:44,757 p=32148 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:49:44,853 p=32148 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:49:44,853 p=32148 u=1001930000 n=ansible INFO| localhost : ok=16 changed=5 unreachable=0 failed=0 skipped=5 rescued=0 ignored=0 < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:49:44.911 (22.004s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:49:44.911 2026/02/05 16:49:44 Cleaning setup resources for the backup 2026/02/05 16:49:44 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 16:49:44 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2026/02/05 16:49:44 Deleting VolumeSnapshotClass 'example-snapclass' < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:49:44.935 (24ms) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:49:44.935 2026/02/05 16:49:44 Deleting DPA CR < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 16:49:44.945 (10ms) • [133.124 seconds] ------------------------------ [AfterSuite]  /alabama/cspi/e2e/kubevirt-plugin/kubevirt_suite_test.go:105 > Enter [AfterSuite] TOP-LEVEL @ 02/05/26 16:49:44.945 < Exit [AfterSuite] TOP-LEVEL @ 02/05/26 16:49:44.96 (15ms) [AfterSuite] PASSED [0.015 seconds] ------------------------------ [ReportAfterSuite] Autogenerated ReportAfterSuite for --junit-report autogenerated by Ginkgo > Enter [ReportAfterSuite] TOP-LEVEL @ 02/05/26 16:49:44.96 < Exit [ReportAfterSuite] TOP-LEVEL @ 02/05/26 16:49:44.967 (7ms) [ReportAfterSuite] PASSED [0.007 seconds] ------------------------------ Summarizing 3 Failures: [FAIL] Native CSI Data Mover: Backup/Restore Openshift Virtualization Workloads  [It] [tc-id:OADP-401] [kubevirt] [Tier1] Started VM should over ceph filesytem mode /alabama/cspi/test_common/backup_restore_app_case.go:52 [FAIL] CSI: Backup/Restore Openshift Virtualization Workloads  [It] [tc-id:OADP-185] [kubevirt] [Tier0] [vf:vm] Backing up started VM should succeed /alabama/cspi/test_common/backup_restore_app_case.go:52 [FAIL] CSI: Backup/Restore Openshift Virtualization Workloads  [It] [tc-id:OADP-186] [kubevirt] [Tier0] [vf:vm] Stopped VM should be restored /alabama/cspi/test_common/backup_restore_app_case.go:52 Ran 4 of 5 Specs in 1319.761 seconds FAIL! -- 1 Passed | 3 Failed | 0 Pending | 1 Skipped --- FAIL: TestOADPE2E (1319.77s) FAIL Ginkgo ran 1 suite in 22m41.134787084s Test Suite Failed + readonly 'RED=\e[31m' + RED='\e[31m' + readonly 'BLUE=\033[34m' + BLUE='\033[34m' + readonly 'CLEAR=\e[39m' + CLEAR='\e[39m' ++ oc get infrastructures cluster -o 'jsonpath={.status.platform}' ++ awk '{print tolower($0)}' + CLOUD_PROVIDER=aws + [[ '' == \t\r\u\e ]] + echo /home/jenkins/.kube/config /home/jenkins/.kube/config + [[ aws == *-arm* ]] + [[ aws == *-fips* ]] + E2E_TIMEOUT_MULTIPLIER=2 + export NAMESPACE=openshift-adp + NAMESPACE=openshift-adp + export PROVIDER=aws + PROVIDER=aws ++ echo aws ++ awk '{print tolower($0)}' + BACKUP_LOCATION=aws + export BACKUP_LOCATION=aws + BACKUP_LOCATION=aws + export BUCKET=ci-op-988mlksm-interopoadp + BUCKET=ci-op-988mlksm-interopoadp + OADP_CREDS_FILE=/tmp/test-settings/credentials + OADP_VSL_CREDS_FILE=/tmp/test-settings/aws_vsl_creds +++ readlink -f /alabama/cspi/test_settings/scripts/test_runner.sh ++ dirname /alabama/cspi/test_settings/scripts/test_runner.sh + readonly SCRIPT_DIR=/alabama/cspi/test_settings/scripts + SCRIPT_DIR=/alabama/cspi/test_settings/scripts ++ cd /alabama/cspi/test_settings/scripts ++ git rev-parse --show-toplevel + readonly TOP_DIR=/alabama/cspi + TOP_DIR=/alabama/cspi + echo /alabama/cspi /alabama/cspi + TESTS_FOLDER=/alabama/cspi/e2e ++ oc get nodes -o 'jsonpath={.items[*].metadata.labels.kubernetes\.io/arch}' ++ tr ' ' '\n' ++ sort -u ++ xargs + export NODES_ARCHITECTURE=amd64 + NODES_ARCHITECTURE=amd64 + export OADP_REPOSITORY=redhat + OADP_REPOSITORY=redhat + SKIP_DPA_CREATION=false ++ oc get ns openshift-storage ++ echo true + OPENSHIFT_STORAGE=true + '[' redhat == upstream-velero ']' + '[' true == true ']' ++ oc get sc ++ awk '$1 ~ /^.+ceph-rbd$/ {print $1}' ++ tail -1 + CEPH_RBD_STORAGE_CLASS=odf-operator-ceph-rbd + '[' -n odf-operator-ceph-rbd ']' + export CEPH_RBD_STORAGE_CLASS + echo 'ceph-rbd StorageClass found: odf-operator-ceph-rbd' ceph-rbd StorageClass found: odf-operator-ceph-rbd ++ oc get storageclass -o 'jsonpath={range .items[*]}{@.metadata.name}{" "}{@.metadata.annotations.storageclass\.kubernetes\.io/is-default-class}{"\n"}{end}' ++ awk '$2=="true"{print $1}' ++ wc -l + NUM_DEFAULT_STORAGE_CLASS=1 + '[' 1 -ne 1 ']' ++ oc get storageclass -o 'jsonpath={.items[?(@.metadata.annotations.storageclass\.kubernetes\.io/is-default-class=='\''true'\'')].metadata.name}' + DEFAULT_SC=odf-operator-ceph-rbd + export STORAGE_CLASS=odf-operator-ceph-rbd + STORAGE_CLASS=odf-operator-ceph-rbd + '[' -n odf-operator-ceph-rbd ']' + '[' odf-operator-ceph-rbd '!=' odf-operator-ceph-rbd ']' + export STORAGE_CLASS_OPENSHIFT_STORAGE=odf-operator-ceph-rbd + STORAGE_CLASS_OPENSHIFT_STORAGE=odf-operator-ceph-rbd + echo 'Using the StorageClass for openshift-storage: odf-operator-ceph-rbd' Using the StorageClass for openshift-storage: odf-operator-ceph-rbd + [[ amd64 != \a\m\d\6\4 ]] + TEST_FILTER='!// || (// && !exclude_aws && (!/target/ || target_aws) ) ' + [[ aws =~ ^(osp|vsphere|gcp-wif|ibmcloud|azure-sts|aro-4) ]] + [[ aws =~ ^azure_sak ]] ++ oc config current-context ++ awk -F / '{print $2}' + SETTINGS_TMP=/alabama/cspi/output_files/api-ci-op-988mlksm-2c502-cspilp-interop-ccitredhat-com:6443 + mkdir -p /alabama/cspi/output_files/api-ci-op-988mlksm-2c502-cspilp-interop-ccitredhat-com:6443 ++ oc get authentication cluster -o 'jsonpath={.spec.serviceAccountIssuer}' + IS_OIDC= + '[' '!' -z ']' + [[ aws == \a\w\s ]] + export PROVIDER=aws + PROVIDER=aws + export CREDS_SECRET_REF=cloud-credentials + CREDS_SECRET_REF=cloud-credentials ++ oc get infrastructures cluster -o 'jsonpath={.status.platformStatus.aws.region}' --allow-missing-template-keys=false + export REGION=us-east-2 + REGION=us-east-2 + settings_script=aws_settings.sh + '[' aws == aws-sts ']' + BUCKET=ci-op-988mlksm-interopoadp + TMP_DIR=/alabama/cspi/output_files/api-ci-op-988mlksm-2c502-cspilp-interop-ccitredhat-com:6443 + source /alabama/cspi/test_settings/scripts/aws_settings.sh ++ cat ++ [[ aws == *aws* ]] ++ cat ++ echo -e '\n }\n}' +++ cat /alabama/cspi/output_files/api-ci-op-988mlksm-2c502-cspilp-interop-ccitredhat-com:6443/settings.json ++ x='{ "metadata": { "namespace": "openshift-adp" }, "spec": { "configuration":{ "velero":{ "defaultPlugins": [ "openshift", "aws" ] } }, "backupLocations": [ { "velero": { "provider": "aws", "default": true, "config": { "region": "us-east-2" }, "credential":{ "name": "cloud-credentials", "key": "cloud" }, "objectStorage":{ "bucket": "ci-op-988mlksm-interopoadp" } } } ] , "snapshotLocations": [ { "velero": { "provider": "aws", "config": { "profile": "default", "region": "us-east-2" } } } ] } }' ++ echo '{ "metadata": { "namespace": "openshift-adp" }, "spec": { "configuration":{ "velero":{ "defaultPlugins": [ "openshift", "aws" ] } }, "backupLocations": [ { "velero": { "provider": "aws", "default": true, "config": { "region": "us-east-2" }, "credential":{ "name": "cloud-credentials", "key": "cloud" }, "objectStorage":{ "bucket": "ci-op-988mlksm-interopoadp" } } } ] , "snapshotLocations": [ { "velero": { "provider": "aws", "config": { "profile": "default", "region": "us-east-2" } } } ] } }' ++ grep -o '^[^#]*' + FILE_SETTINGS_NAME=settings.json + printf '\033[34mGenerated settings file under /alabama/cspi/output_files/api-ci-op-988mlksm-2c502-cspilp-interop-ccitredhat-com:6443/settings.json\e[39m\n' Generated settings file under /alabama/cspi/output_files/api-ci-op-988mlksm-2c502-cspilp-interop-ccitredhat-com:6443/settings.json + cat /alabama/cspi/output_files/api-ci-op-988mlksm-2c502-cspilp-interop-ccitredhat-com:6443/settings.json ++ oc get volumesnapshotclass -o name + for i in $(oc get volumesnapshotclass -o name) + oc annotate volumesnapshotclass.snapshot.storage.k8s.io/csi-aws-vsc snapshot.storage.kubernetes.io/is-default-class- volumesnapshotclass.snapshot.storage.k8s.io/csi-aws-vsc annotated + for i in $(oc get volumesnapshotclass -o name) + oc annotate volumesnapshotclass.snapshot.storage.k8s.io/odf-operator-cephfsplugin-snapclass snapshot.storage.kubernetes.io/is-default-class- volumesnapshotclass.snapshot.storage.k8s.io/odf-operator-cephfsplugin-snapclass annotated + for i in $(oc get volumesnapshotclass -o name) + oc annotate volumesnapshotclass.snapshot.storage.k8s.io/odf-operator-rbdplugin-snapclass snapshot.storage.kubernetes.io/is-default-class- volumesnapshotclass.snapshot.storage.k8s.io/odf-operator-rbdplugin-snapclass annotated ++ ./e2e/must-gather/get-latest-build.sh + oc get configmaps -n default must-gather-image + UPSTREAM_VERSION=99.0.0 ++ oc get OperatorCondition -n openshift-adp -o 'jsonpath={.items[*].metadata.name}' ++ awk -F v '{print $2}' + OADP_VERSION=1.5.3 + '[' -z 1.5.3 ']' + '[' 1.5.3 == 99.0.0 ']' ++ oc get sub redhat-oadp-operator -n openshift-adp -o 'jsonpath={.spec.source}' + OADP_REPO=redhat-operators + '[' -z redhat-operators ']' + '[' redhat-operators == redhat-operators ']' + REGISTRY_PATH=registry.redhat.io/oadp/oadp-mustgather-rhel9: + TAG=1.5.3 + export MUST_GATHER_BUILD=registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 + MUST_GATHER_BUILD=registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 + echo registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 + export MUST_GATHER_BUILD=registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 + MUST_GATHER_BUILD=registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 + '[' -z registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 ']' + export NUM_OF_OADP_INSTANCES=1 + NUM_OF_OADP_INSTANCES=1 ++ echo --focus=interop ++ tr ' ' '\n' ++ grep '^--' ++ tr '\n' ' ' + GINKO_PARAM='--focus=interop ' ++ echo --focus=interop ++ tr ' ' '\n' ++ grep '^-' ++ grep -v '^--' ++ tr '\n' ' ' + TEST_PARAM= + ginkgo run --nodes=1 -mod=mod --show-node-events --flake-attempts 3 --junit-report=/logs/artifacts/junit_oadp_interop_results.xml '--label-filter=!// || (// && !exclude_aws && (!/target/ || target_aws) ) ' --focus=interop -p /alabama/cspi/e2e/ -- -credentials_file=/tmp/test-settings/credentials -vsl_credentials_file=/tmp/test-settings/aws_vsl_creds -oadp_namespace=openshift-adp -settings=/alabama/cspi/output_files/api-ci-op-988mlksm-2c502-cspilp-interop-ccitredhat-com:6443/settings.json -must_gather_image=registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 -timeout_multiplier=2 -skip_dpa_creation=false Ginkgo detected a version mismatch between the Ginkgo CLI and the version of Ginkgo imported by your packages: Ginkgo CLI Version: 2.28.1 Mismatched package versions found: 2.23.4 used by e2e Ginkgo will continue to attempt to run but you may see errors (including flag parsing errors) and should either update your go.mod or your version of the Ginkgo CLI to match. To install the matching version of the CLI run go install github.com/onsi/ginkgo/v2/ginkgo from a path that contains a go.mod file. Alternatively you can use go run github.com/onsi/ginkgo/v2/ginkgo from a path that contains a go.mod file to invoke the matching version of the Ginkgo CLI. If you are attempting to test multiple packages that each have a different version of the Ginkgo library with a single Ginkgo CLI that is currently unsupported.  2026/02/05 16:50:06 Setting up clients 2026/02/05 16:50:06 Getting default StorageClass... 2026/02/05 16:50:06 Checking default storage class count Run the command: oc get sc 2026/02/05 16:50:06 Got default StorageClass odf-operator-ceph-rbd 2026/02/05 16:50:06 oc get sc NAME PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE gp2-csi ebs.csi.aws.com Delete WaitForFirstConsumer true 77m gp3-csi ebs.csi.aws.com Delete WaitForFirstConsumer true 77m odf-operator-ceph-rbd (default) openshift-storage.rbd.csi.ceph.com Delete Immediate true 28m odf-operator-ceph-rbd-virtualization openshift-storage.rbd.csi.ceph.com Delete Immediate true 28m odf-operator-cephfs openshift-storage.cephfs.csi.ceph.com Delete Immediate true 28m openshift-storage.noobaa.io openshift-storage.noobaa.io/obc Delete Immediate false 24m 2026/02/05 16:50:06 Using velero prefix: velero-e2e-b9c51523-02b2-11f1-a139-0a58ac1896e8 2026/02/05 16:50:06 Checking default storage class count Running Suite: OADP E2E Suite - /alabama/cspi/e2e ================================================= Random Seed: 1770310187 Will run 10 of 228 specs ------------------------------ [SynchronizedBeforeSuite]  /alabama/cspi/e2e/e2e_suite_test.go:85 > Enter [SynchronizedBeforeSuite] TOP-LEVEL @ 02/05/26 16:50:06.949 < Exit [SynchronizedBeforeSuite] TOP-LEVEL @ 02/05/26 16:50:06.953 (4ms) > Enter [SynchronizedBeforeSuite] TOP-LEVEL @ 02/05/26 16:50:06.953 2026/02/05 16:50:06 The VSL credentials file: /tmp/test-settings/aws_vsl_creds doesn't exists 2026/02/05 16:50:06 The error message is: stat /tmp/test-settings/aws_vsl_creds: no such file or directory < Exit [SynchronizedBeforeSuite] TOP-LEVEL @ 02/05/26 16:50:06.971 (18ms) [SynchronizedBeforeSuite] PASSED [0.022 seconds] ------------------------------ Backup hooks tests Pre exec hook [tc-id:OADP-92][interop][smoke] [Tier0] [vf:backup-hooks] Cassandra app with Restic /alabama/cspi/e2e/hooks/backup_hooks.go:113 > Enter [BeforeEach] TOP-LEVEL @ 02/05/26 16:50:06.973 < Exit [BeforeEach] TOP-LEVEL @ 02/05/26 16:50:06.974 (0s) > Enter [BeforeEach] Backup hooks tests @ 02/05/26 16:50:06.974 < Exit [BeforeEach] Backup hooks tests @ 02/05/26 16:50:06.98 (7ms) > Enter [JustBeforeEach] TOP-LEVEL @ 02/05/26 16:50:06.98 < Exit [JustBeforeEach] TOP-LEVEL @ 02/05/26 16:50:06.98 (0s) > Enter [It] [tc-id:OADP-92][interop][smoke] [Tier0] [vf:backup-hooks] Cassandra app with Restic @ 02/05/26 16:50:06.98 2026/02/05 16:50:06 Delete all downloadrequest ocp-datavolume-5d53c5a8-02b2-11f1-a828-0a58ac1896e8-356e1ce5-bbf5-4c2d-92d7-3cd818dc9077 ocp-datavolume-5d53c5a8-02b2-11f1-a828-0a58ac1896e8-729cf620-a76c-4559-9539-582517703e13 ocp-datavolume-5d53c5a8-02b2-11f1-a828-0a58ac1896e8-91f2fe42-f935-4809-9389-c4fb890103fb STEP: Create DPA CR @ 02/05/26 16:50:07.013 2026/02/05 16:50:07 restic 2026/02/05 16:50:07 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "582ec69d-1193-406f-a4e9-c8d085eb941c", "resourceVersion": "94845", "generation": 1, "creationTimestamp": "2026-02-05T16:50:07Z", "managedFields": [ { "manager": "e2e.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T16:50:07Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:nodeAgent": { ".": {}, "f:enable": {}, "f:podConfig": { ".": {}, "f:resourceAllocations": {} }, "f:uploaderType": {} }, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift" ], "disableFsBackup": false }, "nodeAgent": { "enable": true, "podConfig": { "resourceAllocations": {} }, "uploaderType": "restic" } }, "features": null, "logFormat": "text" }, "status": {} } Delete all the backups that remained in the phase InProgress Deleting backup CRs in progress Deletion of backup CRs in progress completed Delete all the restores that remained in the phase InProgress Deleting restore CRs in progress Deletion of restore CRs in progress completed STEP: Verify DPA CR setup @ 02/05/26 16:50:07.044 2026/02/05 16:50:07 Waiting for velero pod to be running 2026/02/05 16:50:12 pod: velero-7bf89c676-6d2fw is not yet running with status: {Pending [{PodReadyToStartContainers True 0001-01-01 00:00:00 +0000 UTC 2026-02-05 16:50:08 +0000 UTC } {Initialized True 0001-01-01 00:00:00 +0000 UTC 2026-02-05 16:50:11 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2026-02-05 16:50:07 +0000 UTC ContainersNotReady containers with unready status: [velero]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2026-02-05 16:50:07 +0000 UTC ContainersNotReady containers with unready status: [velero]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2026-02-05 16:50:07 +0000 UTC }] 10.0.60.83 [{10.0.60.83}] 10.129.2.133 [{10.129.2.133}] 2026-02-05 16:50:07 +0000 UTC [{openshift-velero-plugin {nil nil &ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2026-02-05 16:50:07 +0000 UTC,FinishedAt:2026-02-05 16:50:08 +0000 UTC,ContainerID:cri-o://1d9c7f7f5e9928bffde548f5abc492611be76a932cf0b626ae61fdca96e172ac,}} {nil nil nil} true 0 registry.redhat.io/oadp/oadp-velero-plugin-rhel9@sha256:9b888c75a1ddf274b1f0aa053ddbbc9acc3270417712456ffa29ef81a883b38a registry.redhat.io/oadp/oadp-velero-plugin-rhel9@sha256:212589b9f5b75a043c9a7094cb681a39687795c5e78e625beb6d00960ea57e70 cri-o://1d9c7f7f5e9928bffde548f5abc492611be76a932cf0b626ae61fdca96e172ac 0xc000912b29 map[cpu:{{500 -3} {} 500m DecimalSI} memory:{{134217728 0} {} BinarySI}] &ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{134217728 0} {} BinarySI},},Claims:[]ResourceClaim{},} [{plugins /target false } {kube-api-access-5l8mk /var/run/secrets/kubernetes.io/serviceaccount true 0xc000d01960}] &ContainerUser{Linux:&LinuxContainerUser{UID:1000740000,GID:0,SupplementalGroups:[0 1000740000],},} []} {velero-plugin-for-aws {nil nil &ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2026-02-05 16:50:08 +0000 UTC,FinishedAt:2026-02-05 16:50:08 +0000 UTC,ContainerID:cri-o://e5a6215c3021a4c2bcab415c038ad0e0fa3a13b83b5a0522f66006bd0a267f41,}} {nil nil nil} true 0 registry.redhat.io/oadp/oadp-velero-plugin-for-aws-rhel9@sha256:2a099649d3d7101a0b6dff9f6372bc76903ba6ecb6578dbeef8a8b3853f48026 registry.redhat.io/oadp/oadp-velero-plugin-for-aws-rhel9@sha256:2a099649d3d7101a0b6dff9f6372bc76903ba6ecb6578dbeef8a8b3853f48026 cri-o://e5a6215c3021a4c2bcab415c038ad0e0fa3a13b83b5a0522f66006bd0a267f41 0xc000912b88 map[cpu:{{500 -3} {} 500m DecimalSI} memory:{{134217728 0} {} BinarySI}] &ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{134217728 0} {} BinarySI},},Claims:[]ResourceClaim{},} [{plugins /target false } {kube-api-access-5l8mk /var/run/secrets/kubernetes.io/serviceaccount true 0xc000d019d0}] &ContainerUser{Linux:&LinuxContainerUser{UID:1000740000,GID:0,SupplementalGroups:[0 1000740000],},} []} {kubevirt-velero-plugin {nil nil &ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2026-02-05 16:50:09 +0000 UTC,FinishedAt:2026-02-05 16:50:09 +0000 UTC,ContainerID:cri-o://ee602931f97e6e6aed9989643fd2855d2bf8b5f3fad3a6ed8eaa48daa70d9984,}} {nil nil nil} true 0 registry.redhat.io/oadp/oadp-kubevirt-velero-plugin-rhel9@sha256:77d6057b1783872ec65d7d6a88d8a1212c38aacc982c7efd46ed2eb77b5e9e70 registry.redhat.io/oadp/oadp-kubevirt-velero-plugin-rhel9@sha256:684020e409da37fd3a41935b51ac22e506fb7a45e787ae8c0cfd6ac0dfcbff09 cri-o://ee602931f97e6e6aed9989643fd2855d2bf8b5f3fad3a6ed8eaa48daa70d9984 0xc000912c39 map[cpu:{{500 -3} {} 500m DecimalSI} memory:{{134217728 0} {} BinarySI}] &ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{134217728 0} {} BinarySI},},Claims:[]ResourceClaim{},} [{plugins /target false } {kube-api-access-5l8mk /var/run/secrets/kubernetes.io/serviceaccount true 0xc000d01a40}] &ContainerUser{Linux:&LinuxContainerUser{UID:1000740000,GID:0,SupplementalGroups:[0 1000740000],},} []} {hypershift-oadp-plugin {nil nil &ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2026-02-05 16:50:10 +0000 UTC,FinishedAt:2026-02-05 16:50:10 +0000 UTC,ContainerID:cri-o://47a3fc74fefc8dd520fd5a76bf3023ce0a28216cfa13978b5a6e2b7842b406ba,}} {nil nil nil} true 0 registry.redhat.io/oadp/oadp-hypershift-velero-plugin-rhel9@sha256:f8798364f94bb1bf4db264b0439c5a280b40cafa408c47b4160d9cc9c5d87e53 registry.redhat.io/oadp/oadp-hypershift-velero-plugin-rhel9@sha256:5d9c2ff91b5851f486fdcadcf9991007cdbe7a81f57774c6d0b3798091316af6 cri-o://47a3fc74fefc8dd520fd5a76bf3023ce0a28216cfa13978b5a6e2b7842b406ba 0xc000912c98 map[cpu:{{500 -3} {} 500m DecimalSI} memory:{{134217728 0} {} BinarySI}] &ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{134217728 0} {} BinarySI},},Claims:[]ResourceClaim{},} [{plugins /target false } {kube-api-access-5l8mk /var/run/secrets/kubernetes.io/serviceaccount true 0xc000d01ab0}] &ContainerUser{Linux:&LinuxContainerUser{UID:1000740000,GID:0,SupplementalGroups:[0 1000740000],},} []}] [{velero {&ContainerStateWaiting{Reason:PodInitializing,Message:,} nil nil} {nil nil nil} false 0 registry.redhat.io/oadp/oadp-velero-rhel9@sha256:dd5897b1579599cfa8d8a03a1c8d3cf68e3927c4ba5dee4e33c2a2d4c9e6ed89 0xc000912d4f map[] nil [{plugins /plugins false } {scratch /scratch false } {certs /etc/ssl/certs false } {bound-sa-token /var/run/secrets/openshift/serviceaccount true 0xc000d01ac0} {kube-api-access-5l8mk /var/run/secrets/kubernetes.io/serviceaccount true 0xc000d01ae0}] nil []}] Burstable [] []} 2026/02/05 16:50:17 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete' 2026/02/05 16:50:17 DPA successfully reconciled STEP: Prepare backup resources, depending on the volumes backup type @ 02/05/26 16:50:17.076 2026/02/05 16:50:17 Checking for correct number of running NodeAgent pods... STEP: Installing application for case cassandra-hooks-e2e @ 02/05/26 16:50:17.172 2026/02/05 16:50:17 🔄 [Attempt 1/3] Executing operation: Deploy application ocp-cassandra 2026/02/05 16:50:17 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create namespace] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** changed: [localhost] [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** changed: [localhost] FAILED - RETRYING: [localhost]: Check pods status (30 retries left). FAILED - RETRYING: [localhost]: Check pods status (29 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** ok: [localhost] FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3  50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal)  ^ column 3  fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-92 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.170023", "end": "2026-02-05 16:53:32.684827", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 16:53:32.514804", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} PLAY RECAP ********************************************************************* localhost : ok=21  changed=8  unreachable=0 failed=1  skipped=2  rescued=0 ignored=0 2026/02/05 16:53:32 2026-02-05 16:50:19,078 p=33475 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:50:19,079 p=33475 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:50:19,512 p=33475 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:50:19,512 p=33475 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:50:19,904 p=33475 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:50:19,904 p=33475 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:50:20,230 p=33475 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:50:20,230 p=33475 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:50:20,250 p=33475 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:50:20,250 p=33475 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:50:20,250 p=33475 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:50:20,272 p=33475 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:50:20,272 p=33475 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:50:20,287 p=33475 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:50:20,288 p=33475 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:50:20,710 p=33475 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:50:20,711 p=33475 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:50:20,711 p=33475 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:50:20,711 p=33475 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:50:20,740 p=33475 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:50:20,740 p=33475 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:50:20,763 p=33475 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:50:20,764 p=33475 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:50:20,767 p=33475 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:50:21,390 p=33475 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:50:21,390 p=33475 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:50:22,478 p=33475 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** 2026-02-05 16:50:22,479 p=33475 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:50:22,479 p=33475 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:50:22,479 p=33475 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:50:22,479 p=33475 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:50:22,480 p=33475 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:50:22,983 p=33475 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create namespace] *** 2026-02-05 16:50:22,983 p=33475 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:50:23,359 p=33475 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** 2026-02-05 16:50:23,359 p=33475 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:50:24,764 p=33475 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** 2026-02-05 16:50:24,765 p=33475 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:50:25,783 p=33475 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** 2026-02-05 16:50:25,783 p=33475 u=1001930000 n=ansible WARNING| [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" 2026-02-05 16:50:25,784 p=33475 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. 2026-02-05 16:50:25,784 p=33475 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:50:26,777 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (30 retries left). 2026-02-05 16:50:32,749 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (29 retries left). 2026-02-05 16:50:38,739 p=33475 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** 2026-02-05 16:50:38,739 p=33475 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:50:39,256 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). 2026-02-05 16:50:46,930 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). 2026-02-05 16:50:52,348 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). 2026-02-05 16:50:57,755 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). 2026-02-05 16:51:06,332 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). 2026-02-05 16:51:11,895 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). 2026-02-05 16:51:17,357 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). 2026-02-05 16:51:23,210 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). 2026-02-05 16:51:28,658 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). 2026-02-05 16:51:34,067 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). 2026-02-05 16:51:40,729 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). 2026-02-05 16:51:46,536 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). 2026-02-05 16:51:52,311 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). 2026-02-05 16:51:58,159 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). 2026-02-05 16:52:03,890 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). 2026-02-05 16:52:09,668 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). 2026-02-05 16:52:15,460 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). 2026-02-05 16:52:20,933 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). 2026-02-05 16:52:26,389 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). 2026-02-05 16:52:32,076 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). 2026-02-05 16:52:38,633 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). 2026-02-05 16:52:44,052 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). 2026-02-05 16:52:49,440 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). 2026-02-05 16:52:54,819 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). 2026-02-05 16:53:00,222 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). 2026-02-05 16:53:05,661 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). 2026-02-05 16:53:11,098 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). 2026-02-05 16:53:16,498 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). 2026-02-05 16:53:21,888 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). 2026-02-05 16:53:27,318 p=33475 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). 2026-02-05 16:53:32,714 p=33475 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** 2026-02-05 16:53:32,714 p=33475 u=1001930000 n=ansible ERROR| [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3 50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal) ^ column 3 2026-02-05 16:53:32,715 p=33475 u=1001930000 n=ansible INFO| fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-92 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.170023", "end": "2026-02-05 16:53:32.684827", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 16:53:32.514804", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} 2026-02-05 16:53:32,716 p=33475 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:53:32,716 p=33475 u=1001930000 n=ansible INFO| localhost : ok=21 changed=8 unreachable=0 failed=1 skipped=2 rescued=0 ignored=0 Run the command: oc get event -n test-oadp-92 2026/02/05 16:53:32 LAST SEEN TYPE REASON OBJECT MESSAGE 3m7s Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 3m6s Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 3m6s Normal Scheduled pod/cassandra-0 Successfully assigned test-oadp-92/cassandra-0 to ip-10-0-60-83.us-east-2.compute.internal 3m6s Normal SuccessfulAttachVolume pod/cassandra-0 AttachVolume.Attach succeeded for volume "pvc-98ec8679-6ec8-4e61-a3bb-37169e013af0" 3m4s Normal AddedInterface pod/cassandra-0 Add eth0 [10.129.2.135/23] from ovn-kubernetes 61s Normal Pulling pod/cassandra-0 Pulling image "quay.io/migqe/cassandra:multiarch" 3m1s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 3.421s (3.421s including waiting). Image size: 307783610 bytes. 60s Normal Created pod/cassandra-0 Created container: cassandra 60s Normal Started pod/cassandra-0 Started container cassandra 2m52s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 424ms (424ms including waiting). Image size: 307783610 bytes. 13s Warning BackOff pod/cassandra-0 Back-off restarting failed container cassandra in pod cassandra-0_test-oadp-92(e58c7e20-cbd1-4c8e-9f35-5d8c1a9fb3b4) 2m32s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 413ms (413ms including waiting). Image size: 307783610 bytes. 118s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 767ms (767ms including waiting). Image size: 307783610 bytes. 61s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 631ms (631ms including waiting). Image size: 307783610 bytes. 2m59s Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 2m59s Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 2m59s Normal Scheduled pod/cassandra-1 Successfully assigned test-oadp-92/cassandra-1 to ip-10-0-98-206.us-east-2.compute.internal 2m59s Normal SuccessfulAttachVolume pod/cassandra-1 AttachVolume.Attach succeeded for volume "pvc-d559a753-3b68-4b29-906e-3cfe9b6e1241" 2m52s Normal AddedInterface pod/cassandra-1 Add eth0 [10.131.0.78/23] from ovn-kubernetes 58s Normal Pulling pod/cassandra-1 Pulling image "quay.io/migqe/cassandra:multiarch" 2m48s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 3.599s (3.599s including waiting). Image size: 307783610 bytes. 57s Normal Created pod/cassandra-1 Created container: cassandra 57s Normal Started pod/cassandra-1 Started container cassandra 2m43s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 654ms (654ms including waiting). Image size: 307783610 bytes. 3s Warning BackOff pod/cassandra-1 Back-off restarting failed container cassandra in pod cassandra-1_test-oadp-92(0294376b-c560-40cd-b9ac-884f7ac554a3) 2m22s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 466ms (466ms including waiting). Image size: 307783610 bytes. 112s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 420ms (420ms including waiting). Image size: 307783610 bytes. 57s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 567ms (567ms including waiting). Image size: 307783610 bytes. 2m47s Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 2m47s Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 2m47s Normal Scheduled pod/cassandra-2 Successfully assigned test-oadp-92/cassandra-2 to ip-10-0-7-38.us-east-2.compute.internal 2m46s Normal SuccessfulAttachVolume pod/cassandra-2 AttachVolume.Attach succeeded for volume "pvc-186743b7-4ba4-4545-9734-1f4a032fcad2" 2m38s Normal AddedInterface pod/cassandra-2 Add eth0 [10.128.2.48/23] from ovn-kubernetes 54s Normal Pulling pod/cassandra-2 Pulling image "quay.io/migqe/cassandra:multiarch" 2m35s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 3.184s (3.184s including waiting). Image size: 307783610 bytes. 54s Normal Created pod/cassandra-2 Created container: cassandra 54s Normal Started pod/cassandra-2 Started container cassandra 2m27s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 512ms (512ms including waiting). Image size: 307783610 bytes. 7s Warning BackOff pod/cassandra-2 Back-off restarting failed container cassandra in pod cassandra-2_test-oadp-92(3d59cca8-5f1f-410e-b364-1ffbbe7ca45a) 2m10s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 585ms (585ms including waiting). Image size: 307783610 bytes. 100s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 455ms (455ms including waiting). Image size: 307783610 bytes. 54s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 521ms (521ms including waiting). Image size: 307783610 bytes. 3m7s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-0 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 3m7s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-0 External provisioner is provisioning volume for claim "test-oadp-92/cassandra-data-cassandra-0" 3m6s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-0 Successfully provisioned volume pvc-98ec8679-6ec8-4e61-a3bb-37169e013af0 2m59s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-1 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 2m59s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-1 External provisioner is provisioning volume for claim "test-oadp-92/cassandra-data-cassandra-1" 2m59s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-1 Successfully provisioned volume pvc-d559a753-3b68-4b29-906e-3cfe9b6e1241 2m47s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-2 External provisioner is provisioning volume for claim "test-oadp-92/cassandra-data-cassandra-2" 2m47s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-2 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 2m47s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-2 Successfully provisioned volume pvc-186743b7-4ba4-4545-9734-1f4a032fcad2 3m7s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-0 Pod cassandra-0 in StatefulSet cassandra success 3m7s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-0 in StatefulSet cassandra successful 2m59s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-1 Pod cassandra-1 in StatefulSet cassandra success 2m59s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-1 in StatefulSet cassandra successful 2m47s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-2 Pod cassandra-2 in StatefulSet cassandra success 2m47s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-2 in StatefulSet cassandra successful 2026/02/05 16:53:32 Found server error pattern in ansible logs: '502' 2026/02/05 16:53:32 Detected server errors in ansible logs - treating as retryable 2026/02/05 16:53:32 ⚠️ Operation 'Deploy application ocp-cassandra' failed with retryable server error (attempt 1/3): Error during command execution: ansible-playbook error: one or more host failed Command executed: /usr/local/bin/ansible-playbook --extra-vars {"admin_kubeconfig":"/home/jenkins/.kube/config","namespace":"test-oadp-92","non_admin_user":false,"use_role":"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra","user_kubeconfig":"/home/jenkins/.kube/config","with_deploy":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml exit status 2 2026/02/05 16:53:32 🕐 Waiting 1m0s before retry... 2026/02/05 16:54:32 🔄 [Attempt 2/3] Executing operation: Deploy application ocp-cassandra 2026/02/05 16:54:32 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** ok: [localhost] [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** ok: [localhost] FAILED - RETRYING: [localhost]: Check pods status (30 retries left). FAILED - RETRYING: [localhost]: Check pods status (29 retries left). FAILED - RETRYING: [localhost]: Check pods status (28 retries left). FAILED - RETRYING: [localhost]: Check pods status (27 retries left). FAILED - RETRYING: [localhost]: Check pods status (26 retries left). FAILED - RETRYING: [localhost]: Check pods status (25 retries left). FAILED - RETRYING: [localhost]: Check pods status (24 retries left). FAILED - RETRYING: [localhost]: Check pods status (23 retries left). FAILED - RETRYING: [localhost]: Check pods status (22 retries left). FAILED - RETRYING: [localhost]: Check pods status (21 retries left). FAILED - RETRYING: [localhost]: Check pods status (20 retries left). FAILED - RETRYING: [localhost]: Check pods status (19 retries left). FAILED - RETRYING: [localhost]: Check pods status (18 retries left). FAILED - RETRYING: [localhost]: Check pods status (17 retries left). FAILED - RETRYING: [localhost]: Check pods status (16 retries left). FAILED - RETRYING: [localhost]: Check pods status (15 retries left). FAILED - RETRYING: [localhost]: Check pods status (14 retries left). FAILED - RETRYING: [localhost]: Check pods status (13 retries left). FAILED - RETRYING: [localhost]: Check pods status (12 retries left). FAILED - RETRYING: [localhost]: Check pods status (11 retries left). FAILED - RETRYING: [localhost]: Check pods status (10 retries left). FAILED - RETRYING: [localhost]: Check pods status (9 retries left). FAILED - RETRYING: [localhost]: Check pods status (8 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** ok: [localhost] FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3  50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal)  ^ column 3  fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-92 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.169775", "end": "2026-02-05 16:59:47.887196", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 16:59:47.717421", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} PLAY RECAP ********************************************************************* localhost : ok=20  changed=5  unreachable=0 failed=1  skipped=3  rescued=0 ignored=0 2026/02/05 16:59:47 2026-02-05 16:54:34,628 p=34782 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 16:54:34,628 p=34782 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:54:34,947 p=34782 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 16:54:34,947 p=34782 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:54:35,266 p=34782 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 16:54:35,266 p=34782 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:54:35,589 p=34782 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 16:54:35,590 p=34782 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:54:35,608 p=34782 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 16:54:35,609 p=34782 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 16:54:35,609 p=34782 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:54:35,629 p=34782 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 16:54:35,629 p=34782 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:54:35,643 p=34782 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 16:54:35,644 p=34782 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 16:54:36,072 p=34782 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 16:54:36,072 p=34782 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 16:54:36,073 p=34782 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 16:54:36,073 p=34782 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:54:36,103 p=34782 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 16:54:36,103 p=34782 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:54:36,127 p=34782 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 16:54:36,127 p=34782 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:54:36,130 p=34782 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 16:54:36,734 p=34782 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 16:54:36,735 p=34782 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:54:37,811 p=34782 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** 2026-02-05 16:54:37,811 p=34782 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 16:54:37,812 p=34782 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:54:37,812 p=34782 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:54:37,812 p=34782 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 16:54:37,812 p=34782 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:54:38,204 p=34782 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** 2026-02-05 16:54:38,204 p=34782 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 16:54:39,430 p=34782 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** 2026-02-05 16:54:39,431 p=34782 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:54:40,468 p=34782 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** 2026-02-05 16:54:40,469 p=34782 u=1001930000 n=ansible WARNING| [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" 2026-02-05 16:54:40,470 p=34782 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. 2026-02-05 16:54:40,470 p=34782 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:54:41,470 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (30 retries left). 2026-02-05 16:54:47,353 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (29 retries left). 2026-02-05 16:54:53,268 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (28 retries left). 2026-02-05 16:54:59,193 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (27 retries left). 2026-02-05 16:55:05,088 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (26 retries left). 2026-02-05 16:55:11,001 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (25 retries left). 2026-02-05 16:55:17,032 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (24 retries left). 2026-02-05 16:55:22,974 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (23 retries left). 2026-02-05 16:55:28,893 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (22 retries left). 2026-02-05 16:55:34,870 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (21 retries left). 2026-02-05 16:55:40,882 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (20 retries left). 2026-02-05 16:55:46,984 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (19 retries left). 2026-02-05 16:55:52,983 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (18 retries left). 2026-02-05 16:55:59,157 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (17 retries left). 2026-02-05 16:56:05,220 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (16 retries left). 2026-02-05 16:56:11,242 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (15 retries left). 2026-02-05 16:56:17,192 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (14 retries left). 2026-02-05 16:56:23,165 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (13 retries left). 2026-02-05 16:56:29,206 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (12 retries left). 2026-02-05 16:56:35,531 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (11 retries left). 2026-02-05 16:56:41,852 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (10 retries left). 2026-02-05 16:56:48,110 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (9 retries left). 2026-02-05 16:56:54,543 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (8 retries left). 2026-02-05 16:57:00,839 p=34782 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** 2026-02-05 16:57:00,840 p=34782 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 16:57:03,951 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). 2026-02-05 16:57:09,538 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). 2026-02-05 16:57:15,076 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). 2026-02-05 16:57:20,661 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). 2026-02-05 16:57:26,098 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). 2026-02-05 16:57:31,535 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). 2026-02-05 16:57:36,950 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). 2026-02-05 16:57:42,358 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). 2026-02-05 16:57:47,763 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). 2026-02-05 16:57:53,174 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). 2026-02-05 16:57:58,819 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). 2026-02-05 16:58:04,286 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). 2026-02-05 16:58:09,922 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). 2026-02-05 16:58:15,492 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). 2026-02-05 16:58:21,027 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). 2026-02-05 16:58:26,695 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). 2026-02-05 16:58:32,101 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). 2026-02-05 16:58:37,520 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). 2026-02-05 16:58:42,996 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). 2026-02-05 16:58:48,409 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). 2026-02-05 16:58:53,813 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). 2026-02-05 16:58:59,234 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). 2026-02-05 16:59:04,660 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). 2026-02-05 16:59:10,068 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). 2026-02-05 16:59:15,464 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). 2026-02-05 16:59:20,843 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). 2026-02-05 16:59:26,245 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). 2026-02-05 16:59:31,659 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). 2026-02-05 16:59:37,052 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). 2026-02-05 16:59:42,517 p=34782 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). 2026-02-05 16:59:47,915 p=34782 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** 2026-02-05 16:59:47,915 p=34782 u=1001930000 n=ansible ERROR| [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3 50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal) ^ column 3 2026-02-05 16:59:47,916 p=34782 u=1001930000 n=ansible INFO| fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-92 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.169775", "end": "2026-02-05 16:59:47.887196", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 16:59:47.717421", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} 2026-02-05 16:59:47,917 p=34782 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 16:59:47,917 p=34782 u=1001930000 n=ansible INFO| localhost : ok=20 changed=5 unreachable=0 failed=1 skipped=3 rescued=0 ignored=0 Run the command: oc get event -n test-oadp-92 2026/02/05 16:59:48 LAST SEEN TYPE REASON OBJECT MESSAGE 9m22s Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m21s Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m21s Normal Scheduled pod/cassandra-0 Successfully assigned test-oadp-92/cassandra-0 to ip-10-0-60-83.us-east-2.compute.internal 9m22s Normal SuccessfulAttachVolume pod/cassandra-0 AttachVolume.Attach succeeded for volume "pvc-98ec8679-6ec8-4e61-a3bb-37169e013af0" 9m20s Normal AddedInterface pod/cassandra-0 Add eth0 [10.129.2.135/23] from ovn-kubernetes 2m51s Normal Pulling pod/cassandra-0 Pulling image "quay.io/migqe/cassandra:multiarch" 9m17s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 3.421s (3.421s including waiting). Image size: 307783610 bytes. 5m44s Normal Created pod/cassandra-0 Created container: cassandra 5m44s Normal Started pod/cassandra-0 Started container cassandra 9m8s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 424ms (424ms including waiting). Image size: 307783610 bytes. 3m4s Warning BackOff pod/cassandra-0 Back-off restarting failed container cassandra in pod cassandra-0_test-oadp-92(e58c7e20-cbd1-4c8e-9f35-5d8c1a9fb3b4) 8m48s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 413ms (413ms including waiting). Image size: 307783610 bytes. 8m14s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 767ms (767ms including waiting). Image size: 307783610 bytes. 7m17s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 631ms (631ms including waiting). Image size: 307783610 bytes. 5m44s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 753ms (753ms including waiting). Image size: 307783610 bytes. 2m51s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 690ms (690ms including waiting). Image size: 307783610 bytes. 9m15s Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m14s Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m14s Normal Scheduled pod/cassandra-1 Successfully assigned test-oadp-92/cassandra-1 to ip-10-0-98-206.us-east-2.compute.internal 9m15s Normal SuccessfulAttachVolume pod/cassandra-1 AttachVolume.Attach succeeded for volume "pvc-d559a753-3b68-4b29-906e-3cfe9b6e1241" 9m8s Normal AddedInterface pod/cassandra-1 Add eth0 [10.131.0.78/23] from ovn-kubernetes 2m53s Normal Pulling pod/cassandra-1 Pulling image "quay.io/migqe/cassandra:multiarch" 9m4s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 3.599s (3.599s including waiting). Image size: 307783610 bytes. 5m38s Normal Created pod/cassandra-1 Created container: cassandra 5m38s Normal Started pod/cassandra-1 Started container cassandra 8m59s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 654ms (654ms including waiting). Image size: 307783610 bytes. 3m20s Warning BackOff pod/cassandra-1 Back-off restarting failed container cassandra in pod cassandra-1_test-oadp-92(0294376b-c560-40cd-b9ac-884f7ac554a3) 8m38s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 466ms (466ms including waiting). Image size: 307783610 bytes. 8m8s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 420ms (420ms including waiting). Image size: 307783610 bytes. 7m13s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 567ms (567ms including waiting). Image size: 307783610 bytes. 5m38s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 549ms (549ms including waiting). Image size: 307783610 bytes. 2m52s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 588ms (588ms including waiting). Image size: 307783610 bytes. 9m2s Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m2s Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m2s Normal Scheduled pod/cassandra-2 Successfully assigned test-oadp-92/cassandra-2 to ip-10-0-7-38.us-east-2.compute.internal 9m2s Normal SuccessfulAttachVolume pod/cassandra-2 AttachVolume.Attach succeeded for volume "pvc-186743b7-4ba4-4545-9734-1f4a032fcad2" 8m54s Normal AddedInterface pod/cassandra-2 Add eth0 [10.128.2.48/23] from ovn-kubernetes 2m38s Normal Pulling pod/cassandra-2 Pulling image "quay.io/migqe/cassandra:multiarch" 8m51s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 3.184s (3.184s including waiting). Image size: 307783610 bytes. 5m35s Normal Created pod/cassandra-2 Created container: cassandra 5m35s Normal Started pod/cassandra-2 Started container cassandra 8m43s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 512ms (512ms including waiting). Image size: 307783610 bytes. 3m3s Warning BackOff pod/cassandra-2 Back-off restarting failed container cassandra in pod cassandra-2_test-oadp-92(3d59cca8-5f1f-410e-b364-1ffbbe7ca45a) 8m26s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 585ms (585ms including waiting). Image size: 307783610 bytes. 7m56s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 455ms (455ms including waiting). Image size: 307783610 bytes. 7m10s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 521ms (521ms including waiting). Image size: 307783610 bytes. 5m35s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 549ms (549ms including waiting). Image size: 307783610 bytes. 2m38s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 633ms (633ms including waiting). Image size: 307783610 bytes. 9m23s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-0 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 9m23s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-0 External provisioner is provisioning volume for claim "test-oadp-92/cassandra-data-cassandra-0" 9m22s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-0 Successfully provisioned volume pvc-98ec8679-6ec8-4e61-a3bb-37169e013af0 9m15s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-1 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 9m15s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-1 External provisioner is provisioning volume for claim "test-oadp-92/cassandra-data-cassandra-1" 9m15s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-1 Successfully provisioned volume pvc-d559a753-3b68-4b29-906e-3cfe9b6e1241 9m3s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-2 External provisioner is provisioning volume for claim "test-oadp-92/cassandra-data-cassandra-2" 9m3s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-2 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 9m3s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-2 Successfully provisioned volume pvc-186743b7-4ba4-4545-9734-1f4a032fcad2 9m23s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-0 Pod cassandra-0 in StatefulSet cassandra success 9m23s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-0 in StatefulSet cassandra successful 9m15s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-1 Pod cassandra-1 in StatefulSet cassandra success 9m15s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-1 in StatefulSet cassandra successful 9m3s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-2 Pod cassandra-2 in StatefulSet cassandra success 9m3s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-2 in StatefulSet cassandra successful 2026/02/05 16:59:48 Found server error pattern in ansible logs: '502' 2026/02/05 16:59:48 Detected server errors in ansible logs - treating as retryable 2026/02/05 16:59:48 ⚠️ Operation 'Deploy application ocp-cassandra' failed with retryable server error (attempt 2/3): Error during command execution: ansible-playbook error: one or more host failed Command executed: /usr/local/bin/ansible-playbook --extra-vars {"admin_kubeconfig":"/home/jenkins/.kube/config","namespace":"test-oadp-92","non_admin_user":false,"use_role":"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra","user_kubeconfig":"/home/jenkins/.kube/config","with_deploy":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml exit status 2 2026/02/05 16:59:48 🕐 Waiting 2m0s before retry... 2026/02/05 17:01:48 🔄 [Attempt 3/3] Executing operation: Deploy application ocp-cassandra 2026/02/05 17:01:48 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** ok: [localhost] [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** ok: [localhost] FAILED - RETRYING: [localhost]: Check pods status (30 retries left). FAILED - RETRYING: [localhost]: Check pods status (29 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** ok: [localhost] FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3  50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal)  ^ column 3  fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-92 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.180217", "end": "2026-02-05 17:04:55.437171", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 17:04:55.256954", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} PLAY RECAP ********************************************************************* localhost : ok=20  changed=5  unreachable=0 failed=1  skipped=3  rescued=0 ignored=0 2026/02/05 17:04:55 2026-02-05 17:01:49,798 p=36339 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 17:01:49,798 p=36339 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:01:50,116 p=36339 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 17:01:50,116 p=36339 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:01:50,433 p=36339 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 17:01:50,433 p=36339 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:01:50,755 p=36339 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 17:01:50,755 p=36339 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:01:50,774 p=36339 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 17:01:50,774 p=36339 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 17:01:50,774 p=36339 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:01:50,795 p=36339 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 17:01:50,795 p=36339 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:01:50,810 p=36339 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 17:01:50,811 p=36339 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 17:01:51,258 p=36339 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 17:01:51,259 p=36339 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 17:01:51,259 p=36339 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 17:01:51,259 p=36339 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:01:51,289 p=36339 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 17:01:51,289 p=36339 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:01:51,311 p=36339 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 17:01:51,312 p=36339 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:01:51,314 p=36339 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 17:01:51,926 p=36339 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 17:01:51,926 p=36339 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:01:53,064 p=36339 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** 2026-02-05 17:01:53,064 p=36339 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 17:01:53,065 p=36339 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:01:53,065 p=36339 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:01:53,065 p=36339 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:01:53,065 p=36339 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:01:53,452 p=36339 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** 2026-02-05 17:01:53,452 p=36339 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:01:54,579 p=36339 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** 2026-02-05 17:01:54,580 p=36339 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:01:55,616 p=36339 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** 2026-02-05 17:01:55,616 p=36339 u=1001930000 n=ansible WARNING| [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" 2026-02-05 17:01:55,617 p=36339 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. 2026-02-05 17:01:55,617 p=36339 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:01:56,586 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (30 retries left). 2026-02-05 17:02:02,506 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (29 retries left). 2026-02-05 17:02:08,430 p=36339 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** 2026-02-05 17:02:08,430 p=36339 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:02:12,736 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). 2026-02-05 17:02:18,134 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). 2026-02-05 17:02:23,527 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). 2026-02-05 17:02:28,937 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). 2026-02-05 17:02:34,346 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). 2026-02-05 17:02:39,786 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). 2026-02-05 17:02:45,184 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). 2026-02-05 17:02:50,581 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). 2026-02-05 17:02:55,967 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). 2026-02-05 17:03:01,392 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). 2026-02-05 17:03:06,799 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). 2026-02-05 17:03:12,204 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). 2026-02-05 17:03:17,603 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). 2026-02-05 17:03:23,021 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). 2026-02-05 17:03:28,420 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). 2026-02-05 17:03:33,840 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). 2026-02-05 17:03:39,238 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). 2026-02-05 17:03:44,633 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). 2026-02-05 17:03:50,038 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). 2026-02-05 17:03:55,456 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). 2026-02-05 17:04:00,960 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). 2026-02-05 17:04:06,366 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). 2026-02-05 17:04:12,074 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). 2026-02-05 17:04:17,501 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). 2026-02-05 17:04:22,907 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). 2026-02-05 17:04:28,338 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). 2026-02-05 17:04:33,753 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). 2026-02-05 17:04:39,180 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). 2026-02-05 17:04:44,617 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). 2026-02-05 17:04:50,058 p=36339 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). 2026-02-05 17:04:55,467 p=36339 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** 2026-02-05 17:04:55,467 p=36339 u=1001930000 n=ansible ERROR| [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3 50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal) ^ column 3 2026-02-05 17:04:55,468 p=36339 u=1001930000 n=ansible INFO| fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-92 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.180217", "end": "2026-02-05 17:04:55.437171", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 17:04:55.256954", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} 2026-02-05 17:04:55,468 p=36339 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 17:04:55,469 p=36339 u=1001930000 n=ansible INFO| localhost : ok=20 changed=5 unreachable=0 failed=1 skipped=3 rescued=0 ignored=0 Run the command: oc get event -n test-oadp-92 2026/02/05 17:04:55 LAST SEEN TYPE REASON OBJECT MESSAGE 14m Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Normal Scheduled pod/cassandra-0 Successfully assigned test-oadp-92/cassandra-0 to ip-10-0-60-83.us-east-2.compute.internal 14m Normal SuccessfulAttachVolume pod/cassandra-0 AttachVolume.Attach succeeded for volume "pvc-98ec8679-6ec8-4e61-a3bb-37169e013af0" 14m Normal AddedInterface pod/cassandra-0 Add eth0 [10.129.2.135/23] from ovn-kubernetes 2m48s Normal Pulling pod/cassandra-0 Pulling image "quay.io/migqe/cassandra:multiarch" 14m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 3.421s (3.421s including waiting). Image size: 307783610 bytes. 10m Normal Created pod/cassandra-0 Created container: cassandra 10m Normal Started pod/cassandra-0 Started container cassandra 14m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 424ms (424ms including waiting). Image size: 307783610 bytes. 4m5s Warning BackOff pod/cassandra-0 Back-off restarting failed container cassandra in pod cassandra-0_test-oadp-92(e58c7e20-cbd1-4c8e-9f35-5d8c1a9fb3b4) 13m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 413ms (413ms including waiting). Image size: 307783610 bytes. 13m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 767ms (767ms including waiting). Image size: 307783610 bytes. 12m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 631ms (631ms including waiting). Image size: 307783610 bytes. 10m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 753ms (753ms including waiting). Image size: 307783610 bytes. 7m58s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 690ms (690ms including waiting). Image size: 307783610 bytes. 14m Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Normal Scheduled pod/cassandra-1 Successfully assigned test-oadp-92/cassandra-1 to ip-10-0-98-206.us-east-2.compute.internal 14m Normal SuccessfulAttachVolume pod/cassandra-1 AttachVolume.Attach succeeded for volume "pvc-d559a753-3b68-4b29-906e-3cfe9b6e1241" 14m Normal AddedInterface pod/cassandra-1 Add eth0 [10.131.0.78/23] from ovn-kubernetes 2m50s Normal Pulling pod/cassandra-1 Pulling image "quay.io/migqe/cassandra:multiarch" 14m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 3.599s (3.599s including waiting). Image size: 307783610 bytes. 10m Normal Created pod/cassandra-1 Created container: cassandra 10m Normal Started pod/cassandra-1 Started container cassandra 14m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 654ms (654ms including waiting). Image size: 307783610 bytes. 3m46s Warning BackOff pod/cassandra-1 Back-off restarting failed container cassandra in pod cassandra-1_test-oadp-92(0294376b-c560-40cd-b9ac-884f7ac554a3) 13m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 466ms (466ms including waiting). Image size: 307783610 bytes. 13m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 420ms (420ms including waiting). Image size: 307783610 bytes. 12m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 567ms (567ms including waiting). Image size: 307783610 bytes. 10m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 549ms (549ms including waiting). Image size: 307783610 bytes. 7m59s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 588ms (588ms including waiting). Image size: 307783610 bytes. 14m Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Normal Scheduled pod/cassandra-2 Successfully assigned test-oadp-92/cassandra-2 to ip-10-0-7-38.us-east-2.compute.internal 14m Normal SuccessfulAttachVolume pod/cassandra-2 AttachVolume.Attach succeeded for volume "pvc-186743b7-4ba4-4545-9734-1f4a032fcad2" 14m Normal AddedInterface pod/cassandra-2 Add eth0 [10.128.2.48/23] from ovn-kubernetes 2m35s Normal Pulling pod/cassandra-2 Pulling image "quay.io/migqe/cassandra:multiarch" 13m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 3.184s (3.184s including waiting). Image size: 307783610 bytes. 10m Normal Created pod/cassandra-2 Created container: cassandra 10m Normal Started pod/cassandra-2 Started container cassandra 13m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 512ms (512ms including waiting). Image size: 307783610 bytes. 3m36s Warning BackOff pod/cassandra-2 Back-off restarting failed container cassandra in pod cassandra-2_test-oadp-92(3d59cca8-5f1f-410e-b364-1ffbbe7ca45a) 13m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 585ms (585ms including waiting). Image size: 307783610 bytes. 13m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 455ms (455ms including waiting). Image size: 307783610 bytes. 12m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 521ms (521ms including waiting). Image size: 307783610 bytes. 10m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 549ms (549ms including waiting). Image size: 307783610 bytes. 7m45s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 633ms (633ms including waiting). Image size: 307783610 bytes. 14m Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-0 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 14m Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-0 External provisioner is provisioning volume for claim "test-oadp-92/cassandra-data-cassandra-0" 14m Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-0 Successfully provisioned volume pvc-98ec8679-6ec8-4e61-a3bb-37169e013af0 14m Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-1 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 14m Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-1 External provisioner is provisioning volume for claim "test-oadp-92/cassandra-data-cassandra-1" 14m Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-1 Successfully provisioned volume pvc-d559a753-3b68-4b29-906e-3cfe9b6e1241 14m Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-2 External provisioner is provisioning volume for claim "test-oadp-92/cassandra-data-cassandra-2" 14m Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-2 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 14m Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-2 Successfully provisioned volume pvc-186743b7-4ba4-4545-9734-1f4a032fcad2 14m Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-0 Pod cassandra-0 in StatefulSet cassandra success 14m Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-0 in StatefulSet cassandra successful 14m Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-1 Pod cassandra-1 in StatefulSet cassandra success 14m Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-1 in StatefulSet cassandra successful 14m Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-2 Pod cassandra-2 in StatefulSet cassandra success 14m Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-2 in StatefulSet cassandra successful 2026/02/05 17:04:55 Found server error pattern in ansible logs: '502' 2026/02/05 17:04:55 Detected server errors in ansible logs - treating as retryable 2026/02/05 17:04:55 ❌ Operation 'Deploy application ocp-cassandra' failed after 3 attempts. Final error: Error during command execution: ansible-playbook error: one or more host failed Command executed: /usr/local/bin/ansible-playbook --extra-vars {"admin_kubeconfig":"/home/jenkins/.kube/config","namespace":"test-oadp-92","non_admin_user":false,"use_role":"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra","user_kubeconfig":"/home/jenkins/.kube/config","with_deploy":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml exit status 2 [FAILED] in [It] - /alabama/cspi/test_common/backup_restore_app_case.go:49 @ 02/05/26 17:04:55.654 < Exit [It] [tc-id:OADP-92][interop][smoke] [Tier0] [vf:backup-hooks] Cassandra app with Restic @ 02/05/26 17:04:55.654 (14m48.674s) > Enter [JustAfterEach] TOP-LEVEL @ 02/05/26 17:04:55.654 2026/02/05 17:04:55 Using Must-gather image: registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 STEP: Get the failed spec name @ 02/05/26 17:04:55.655 2026/02/05 17:04:55 The failed spec name is: Backup hooks tests Pre exec hook [tc-id:OADP-92][interop][smoke] [Tier0] [vf:backup-hooks] Cassandra app with Restic STEP: Create a folder for all must-gather files if it doesn't exists already @ 02/05/26 17:04:55.655 2026/02/05 17:04:55 The folder logs does not exists, creating new folder with the name: logs STEP: Create a folder for the failed spec if it doesn't exists already @ 02/05/26 17:04:55.655 2026/02/05 17:04:55 The folder logs/It_Backup_hooks_tests_Pre_exec_hook_tc-id_OADP-92_interop_smoke_Tier0_vf_backup-hooks_Cassandra_app_with_Restic does not exists, creating new folder with the name: logs/It_Backup_hooks_tests_Pre_exec_hook_tc-id_OADP-92_interop_smoke_Tier0_vf_backup-hooks_Cassandra_app_with_Restic STEP: Run must-gather because the spec failed @ 02/05/26 17:04:55.655 2026/02/05 17:04:55 Log the present working directory path:- /alabama/cspi/e2e 2026/02/05 17:04:55 [adm must-gather --dest-dir /alabama/cspi/e2e/logs/It_Backup_hooks_tests_Pre_exec_hook_tc-id_OADP-92_interop_smoke_Tier0_vf_backup-hooks_Cassandra_app_with_Restic --image registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3] 2026/02/05 17:05:13 Log all the files present in /alabama/cspi/e2e/logs directory 2026/02/05 17:05:13 It_Backup_hooks_tests_Pre_exec_hook_tc-id_OADP-92_interop_smoke_Tier0_vf_backup-hooks_Cassandra_app_with_Restic STEP: Find must-gather folder and rename it to a shorter more readable name @ 02/05/26 17:05:13.742 Secret deletion flag: true Deleting cloud credentials secret cloud-credentials in namespace openshift-adp < Exit [JustAfterEach] TOP-LEVEL @ 02/05/26 17:05:13.763 (18.109s) > Enter [DeferCleanup (Each)] Pre exec hook @ 02/05/26 17:05:13.763 2026/02/05 17:05:13 Cleaning app 2026/02/05 17:05:13 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Remove namespace test-oadp-92] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=16  changed=5  unreachable=0 failed=0 skipped=22  rescued=0 ignored=0 2026/02/05 17:05:44 2026-02-05 17:05:15,575 p=37722 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 17:05:15,575 p=37722 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:05:15,907 p=37722 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 17:05:15,907 p=37722 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:05:16,249 p=37722 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 17:05:16,249 p=37722 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:05:16,577 p=37722 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 17:05:16,577 p=37722 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:05:16,595 p=37722 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 17:05:16,595 p=37722 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 17:05:16,595 p=37722 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:05:16,615 p=37722 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 17:05:16,615 p=37722 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:05:16,629 p=37722 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 17:05:16,630 p=37722 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 17:05:17,090 p=37722 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 17:05:17,091 p=37722 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 17:05:17,091 p=37722 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 17:05:17,091 p=37722 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:05:17,121 p=37722 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 17:05:17,121 p=37722 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:05:17,144 p=37722 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 17:05:17,145 p=37722 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:05:17,147 p=37722 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 17:05:17,770 p=37722 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 17:05:17,770 p=37722 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:05:43,982 p=37722 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Remove namespace test-oadp-92] *** 2026-02-05 17:05:43,982 p=37722 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 17:05:43,983 p=37722 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:05:43,983 p=37722 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:05:43,983 p=37722 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:05:43,983 p=37722 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:05:44,420 p=37722 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 17:05:44,420 p=37722 u=1001930000 n=ansible INFO| localhost : ok=16 changed=5 unreachable=0 failed=0 skipped=22 rescued=0 ignored=0 < Exit [DeferCleanup (Each)] Pre exec hook @ 02/05/26 17:05:44.497 (30.734s) > Enter [DeferCleanup (Each)] Pre exec hook @ 02/05/26 17:05:44.497 2026/02/05 17:05:44 Cleaning setup resources for the backup < Exit [DeferCleanup (Each)] Pre exec hook @ 02/05/26 17:05:44.497 (0s) > Enter [DeferCleanup (Each)] Pre exec hook @ 02/05/26 17:05:44.497 2026/02/05 17:05:44 Deleting DPA CR < Exit [DeferCleanup (Each)] Pre exec hook @ 02/05/26 17:05:44.508 (10ms) Attempt #1 Failed. Retrying ↺ @ 02/05/26 17:05:44.508 > Enter [BeforeEach] TOP-LEVEL @ 02/05/26 17:05:44.508 < Exit [BeforeEach] TOP-LEVEL @ 02/05/26 17:05:44.508 (0s) > Enter [BeforeEach] Backup hooks tests @ 02/05/26 17:05:44.508 < Exit [BeforeEach] Backup hooks tests @ 02/05/26 17:05:44.514 (6ms) > Enter [JustBeforeEach] TOP-LEVEL @ 02/05/26 17:05:44.514 < Exit [JustBeforeEach] TOP-LEVEL @ 02/05/26 17:05:44.515 (0s) > Enter [It] [tc-id:OADP-92][interop][smoke] [Tier0] [vf:backup-hooks] Cassandra app with Restic @ 02/05/26 17:05:44.515 2026/02/05 17:05:44 Delete all downloadrequest ocp-datavolume-5d53c5a8-02b2-11f1-a828-0a58ac1896e8-27ce2343-0945-49d6-b05a-8987e7bc7e44 ocp-datavolume-5d53c5a8-02b2-11f1-a828-0a58ac1896e8-8bf6d93d-85d4-49f1-b736-50bf33f61058 STEP: Create DPA CR @ 02/05/26 17:05:44.578 2026/02/05 17:05:44 restic 2026/02/05 17:05:44 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "7689fef1-fe6c-46c1-b30a-778d6229d98d", "resourceVersion": "109539", "generation": 1, "creationTimestamp": "2026-02-05T17:05:44Z", "managedFields": [ { "manager": "e2e.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T17:05:44Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:nodeAgent": { ".": {}, "f:enable": {}, "f:podConfig": { ".": {}, "f:resourceAllocations": {} }, "f:uploaderType": {} }, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift" ], "disableFsBackup": false }, "nodeAgent": { "enable": true, "podConfig": { "resourceAllocations": {} }, "uploaderType": "restic" } }, "features": null, "logFormat": "text" }, "status": {} } Delete all the backups that remained in the phase InProgress Deleting backup CRs in progress Deletion of backup CRs in progress completed Delete all the restores that remained in the phase InProgress Deleting restore CRs in progress Deletion of restore CRs in progress completed STEP: Verify DPA CR setup @ 02/05/26 17:05:44.639 2026/02/05 17:05:44 Waiting for velero pod to be running 2026/02/05 17:05:44 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete' 2026/02/05 17:05:44 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "7689fef1-fe6c-46c1-b30a-778d6229d98d", "resourceVersion": "109539", "generation": 1, "creationTimestamp": "2026-02-05T17:05:44Z", "managedFields": [ { "manager": "e2e.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T17:05:44Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:nodeAgent": { ".": {}, "f:enable": {}, "f:podConfig": { ".": {}, "f:resourceAllocations": {} }, "f:uploaderType": {} }, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift" ], "disableFsBackup": false }, "nodeAgent": { "enable": true, "podConfig": { "resourceAllocations": {} }, "uploaderType": "restic" } }, "features": null, "logFormat": "text" }, "status": {} } 2026/02/05 17:05:49 DPA successfully reconciled STEP: Prepare backup resources, depending on the volumes backup type @ 02/05/26 17:05:49.664 2026/02/05 17:05:49 Checking for correct number of running NodeAgent pods... STEP: Installing application for case cassandra-hooks-e2e @ 02/05/26 17:05:49.683 2026/02/05 17:05:49 🔄 [Attempt 1/3] Executing operation: Deploy application ocp-cassandra 2026/02/05 17:05:49 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create namespace] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** changed: [localhost] [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** changed: [localhost] FAILED - RETRYING: [localhost]: Check pods status (30 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** ok: [localhost] FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3  50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal)  ^ column 3  fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-92 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.167930", "end": "2026-02-05 17:09:07.532266", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 17:09:07.364336", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} PLAY RECAP ********************************************************************* localhost : ok=21  changed=8  unreachable=0 failed=1  skipped=2  rescued=0 ignored=0 2026/02/05 17:09:07 2026-02-05 17:05:52,525 p=37949 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 17:05:52,525 p=37949 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:05:53,096 p=37949 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 17:05:53,096 p=37949 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:05:53,630 p=37949 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 17:05:53,630 p=37949 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:05:54,179 p=37949 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 17:05:54,180 p=37949 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:05:54,209 p=37949 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 17:05:54,211 p=37949 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 17:05:54,211 p=37949 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:05:54,246 p=37949 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 17:05:54,247 p=37949 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:05:54,273 p=37949 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 17:05:54,274 p=37949 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 17:05:54,994 p=37949 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 17:05:54,995 p=37949 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 17:05:54,996 p=37949 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 17:05:54,996 p=37949 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:05:55,046 p=37949 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 17:05:55,046 p=37949 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:05:55,083 p=37949 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 17:05:55,083 p=37949 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:05:55,087 p=37949 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 17:05:55,991 p=37949 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 17:05:55,992 p=37949 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:05:57,894 p=37949 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** 2026-02-05 17:05:57,894 p=37949 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 17:05:57,895 p=37949 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:05:57,895 p=37949 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:05:57,896 p=37949 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:05:57,896 p=37949 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:05:58,590 p=37949 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create namespace] *** 2026-02-05 17:05:58,590 p=37949 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:05:59,186 p=37949 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** 2026-02-05 17:05:59,186 p=37949 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:06:01,186 p=37949 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** 2026-02-05 17:06:01,187 p=37949 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:06:02,840 p=37949 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** 2026-02-05 17:06:02,841 p=37949 u=1001930000 n=ansible WARNING| [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" 2026-02-05 17:06:02,841 p=37949 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. 2026-02-05 17:06:02,841 p=37949 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:06:04,172 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (30 retries left). 2026-02-05 17:06:10,146 p=37949 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** 2026-02-05 17:06:10,147 p=37949 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:06:14,435 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). 2026-02-05 17:06:21,229 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). 2026-02-05 17:06:26,625 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). 2026-02-05 17:06:32,052 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). 2026-02-05 17:06:41,438 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). 2026-02-05 17:06:46,947 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). 2026-02-05 17:06:52,481 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). 2026-02-05 17:06:57,896 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). 2026-02-05 17:07:03,309 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). 2026-02-05 17:07:08,722 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). 2026-02-05 17:07:18,130 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). 2026-02-05 17:07:23,562 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). 2026-02-05 17:07:28,963 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). 2026-02-05 17:07:34,372 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). 2026-02-05 17:07:39,775 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). 2026-02-05 17:07:45,201 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). 2026-02-05 17:07:50,593 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). 2026-02-05 17:07:55,997 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). 2026-02-05 17:08:01,389 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). 2026-02-05 17:08:06,789 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). 2026-02-05 17:08:13,538 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). 2026-02-05 17:08:18,952 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). 2026-02-05 17:08:24,387 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). 2026-02-05 17:08:29,780 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). 2026-02-05 17:08:35,159 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). 2026-02-05 17:08:40,585 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). 2026-02-05 17:08:45,975 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). 2026-02-05 17:08:51,372 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). 2026-02-05 17:08:56,772 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). 2026-02-05 17:09:02,167 p=37949 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). 2026-02-05 17:09:07,560 p=37949 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** 2026-02-05 17:09:07,560 p=37949 u=1001930000 n=ansible ERROR| [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3 50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal) ^ column 3 2026-02-05 17:09:07,561 p=37949 u=1001930000 n=ansible INFO| fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-92 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.167930", "end": "2026-02-05 17:09:07.532266", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 17:09:07.364336", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} 2026-02-05 17:09:07,561 p=37949 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 17:09:07,561 p=37949 u=1001930000 n=ansible INFO| localhost : ok=21 changed=8 unreachable=0 failed=1 skipped=2 rescued=0 ignored=0 Run the command: oc get event -n test-oadp-92 2026/02/05 17:09:07 LAST SEEN TYPE REASON OBJECT MESSAGE 3m5s Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 3m4s Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 3m4s Normal Scheduled pod/cassandra-0 Successfully assigned test-oadp-92/cassandra-0 to ip-10-0-60-83.us-east-2.compute.internal 3m4s Normal SuccessfulAttachVolume pod/cassandra-0 AttachVolume.Attach succeeded for volume "pvc-9c848278-e349-499e-9db0-2925ed296404" 3m Normal AddedInterface pod/cassandra-0 Add eth0 [10.129.2.154/23] from ovn-kubernetes 60s Normal Pulling pod/cassandra-0 Pulling image "quay.io/migqe/cassandra:multiarch" 2m59s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 599ms (599ms including waiting). Image size: 307783610 bytes. 60s Normal Created pod/cassandra-0 Created container: cassandra 60s Normal Started pod/cassandra-0 Started container cassandra 2m52s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 753ms (753ms including waiting). Image size: 307783610 bytes. 10s Warning BackOff pod/cassandra-0 Back-off restarting failed container cassandra in pod cassandra-0_test-oadp-92(2061f717-413e-4d15-9c73-02af8e628837) 2m31s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 583ms (583ms including waiting). Image size: 307783610 bytes. 115s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 525ms (525ms including waiting). Image size: 307783610 bytes. 60s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 558ms (558ms including waiting). Image size: 307783610 bytes. 2m59s Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 2m58s Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 2m58s Normal Scheduled pod/cassandra-1 Successfully assigned test-oadp-92/cassandra-1 to ip-10-0-98-206.us-east-2.compute.internal 2m58s Normal SuccessfulAttachVolume pod/cassandra-1 AttachVolume.Attach succeeded for volume "pvc-44f2cc22-62d4-4752-8d95-cfd1d2323294" 2m56s Normal AddedInterface pod/cassandra-1 Add eth0 [10.131.0.81/23] from ovn-kubernetes 69s Normal Pulling pod/cassandra-1 Pulling image "quay.io/migqe/cassandra:multiarch" 2m55s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 765ms (766ms including waiting). Image size: 307783610 bytes. 69s Normal Created pod/cassandra-1 Created container: cassandra 69s Normal Started pod/cassandra-1 Started container cassandra 2m47s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 437ms (437ms including waiting). Image size: 307783610 bytes. 13s Warning BackOff pod/cassandra-1 Back-off restarting failed container cassandra in pod cassandra-1_test-oadp-92(a587fc95-e091-4564-aafd-046c4824bc6a) 2m29s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 414ms (414ms including waiting). Image size: 307783610 bytes. 2m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 609ms (609ms including waiting). Image size: 307783610 bytes. 69s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 394ms (394ms including waiting). Image size: 307783610 bytes. 2m54s Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 2m54s Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 2m54s Normal Scheduled pod/cassandra-2 Successfully assigned test-oadp-92/cassandra-2 to ip-10-0-7-38.us-east-2.compute.internal 2m54s Normal SuccessfulAttachVolume pod/cassandra-2 AttachVolume.Attach succeeded for volume "pvc-36e74570-4889-411d-92dd-4642e097eac6" 2m44s Normal AddedInterface pod/cassandra-2 Add eth0 [10.128.2.50/23] from ovn-kubernetes 62s Normal Pulling pod/cassandra-2 Pulling image "quay.io/migqe/cassandra:multiarch" 2m43s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 540ms (540ms including waiting). Image size: 307783610 bytes. 62s Normal Created pod/cassandra-2 Created container: cassandra 62s Normal Started pod/cassandra-2 Started container cassandra 2m38s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 467ms (467ms including waiting). Image size: 307783610 bytes. 2s Warning BackOff pod/cassandra-2 Back-off restarting failed container cassandra in pod cassandra-2_test-oadp-92(7facd60c-d90f-4ef1-84d5-93f2c7afbc13) 2m20s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 516ms (516ms including waiting). Image size: 307783610 bytes. 108s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 698ms (698ms including waiting). Image size: 307783610 bytes. 62s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 552ms (552ms including waiting). Image size: 307783610 bytes. 3m5s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-0 External provisioner is provisioning volume for claim "test-oadp-92/cassandra-data-cassandra-0" 3m5s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-0 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 3m5s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-0 Successfully provisioned volume pvc-9c848278-e349-499e-9db0-2925ed296404 2m59s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-1 External provisioner is provisioning volume for claim "test-oadp-92/cassandra-data-cassandra-1" 2m59s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-1 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 2m59s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-1 Successfully provisioned volume pvc-44f2cc22-62d4-4752-8d95-cfd1d2323294 2m54s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-2 External provisioner is provisioning volume for claim "test-oadp-92/cassandra-data-cassandra-2" 2m54s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-2 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 2m54s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-2 Successfully provisioned volume pvc-36e74570-4889-411d-92dd-4642e097eac6 3m5s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-0 Pod cassandra-0 in StatefulSet cassandra success 3m5s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-0 in StatefulSet cassandra successful 2m59s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-1 Pod cassandra-1 in StatefulSet cassandra success 2m59s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-1 in StatefulSet cassandra successful 2m54s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-2 Pod cassandra-2 in StatefulSet cassandra success 2m54s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-2 in StatefulSet cassandra successful 2026/02/05 17:09:07 Found server error pattern in ansible logs: '502' 2026/02/05 17:09:07 Detected server errors in ansible logs - treating as retryable 2026/02/05 17:09:07 ⚠️ Operation 'Deploy application ocp-cassandra' failed with retryable server error (attempt 1/3): Error during command execution: ansible-playbook error: one or more host failed Command executed: /usr/local/bin/ansible-playbook --extra-vars {"admin_kubeconfig":"/home/jenkins/.kube/config","namespace":"test-oadp-92","non_admin_user":false,"use_role":"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra","user_kubeconfig":"/home/jenkins/.kube/config","with_deploy":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml exit status 2 2026/02/05 17:09:07 🕐 Waiting 1m0s before retry... 2026/02/05 17:10:07 🔄 [Attempt 2/3] Executing operation: Deploy application ocp-cassandra 2026/02/05 17:10:07 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** ok: [localhost] [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** ok: [localhost] FAILED - RETRYING: [localhost]: Check pods status (30 retries left). FAILED - RETRYING: [localhost]: Check pods status (29 retries left). FAILED - RETRYING: [localhost]: Check pods status (28 retries left). FAILED - RETRYING: [localhost]: Check pods status (27 retries left). FAILED - RETRYING: [localhost]: Check pods status (26 retries left). FAILED - RETRYING: [localhost]: Check pods status (25 retries left). FAILED - RETRYING: [localhost]: Check pods status (24 retries left). FAILED - RETRYING: [localhost]: Check pods status (23 retries left). FAILED - RETRYING: [localhost]: Check pods status (22 retries left). FAILED - RETRYING: [localhost]: Check pods status (21 retries left). FAILED - RETRYING: [localhost]: Check pods status (20 retries left). FAILED - RETRYING: [localhost]: Check pods status (19 retries left). FAILED - RETRYING: [localhost]: Check pods status (18 retries left). FAILED - RETRYING: [localhost]: Check pods status (17 retries left). FAILED - RETRYING: [localhost]: Check pods status (16 retries left). FAILED - RETRYING: [localhost]: Check pods status (15 retries left). FAILED - RETRYING: [localhost]: Check pods status (14 retries left). FAILED - RETRYING: [localhost]: Check pods status (13 retries left). FAILED - RETRYING: [localhost]: Check pods status (12 retries left). FAILED - RETRYING: [localhost]: Check pods status (11 retries left). FAILED - RETRYING: [localhost]: Check pods status (10 retries left). FAILED - RETRYING: [localhost]: Check pods status (9 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** ok: [localhost] FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3  50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal)  ^ column 3  fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-92 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.180371", "end": "2026-02-05 17:15:19.362467", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 17:15:19.182096", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} PLAY RECAP ********************************************************************* localhost : ok=20  changed=5  unreachable=0 failed=1  skipped=3  rescued=0 ignored=0 2026/02/05 17:15:19 2026-02-05 17:10:09,674 p=39250 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 17:10:09,674 p=39250 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:10:10,021 p=39250 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 17:10:10,022 p=39250 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:10:10,347 p=39250 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 17:10:10,347 p=39250 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:10:10,680 p=39250 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 17:10:10,680 p=39250 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:10:10,700 p=39250 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 17:10:10,700 p=39250 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 17:10:10,700 p=39250 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:10:10,721 p=39250 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 17:10:10,722 p=39250 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:10:10,739 p=39250 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 17:10:10,739 p=39250 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 17:10:11,243 p=39250 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 17:10:11,244 p=39250 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 17:10:11,244 p=39250 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 17:10:11,244 p=39250 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:10:11,281 p=39250 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 17:10:11,282 p=39250 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:10:11,307 p=39250 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 17:10:11,307 p=39250 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:10:11,311 p=39250 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 17:10:11,947 p=39250 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 17:10:11,948 p=39250 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:10:13,144 p=39250 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** 2026-02-05 17:10:13,145 p=39250 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 17:10:13,145 p=39250 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:10:13,145 p=39250 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:10:13,145 p=39250 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:10:13,145 p=39250 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:10:13,529 p=39250 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** 2026-02-05 17:10:13,529 p=39250 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:10:14,752 p=39250 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** 2026-02-05 17:10:14,753 p=39250 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:10:15,776 p=39250 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** 2026-02-05 17:10:15,776 p=39250 u=1001930000 n=ansible WARNING| [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" 2026-02-05 17:10:15,777 p=39250 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. 2026-02-05 17:10:15,777 p=39250 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:10:16,776 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (30 retries left). 2026-02-05 17:10:22,679 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (29 retries left). 2026-02-05 17:10:28,622 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (28 retries left). 2026-02-05 17:10:34,643 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (27 retries left). 2026-02-05 17:10:40,711 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (26 retries left). 2026-02-05 17:10:46,710 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (25 retries left). 2026-02-05 17:10:53,140 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (24 retries left). 2026-02-05 17:10:59,621 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (23 retries left). 2026-02-05 17:11:06,113 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (22 retries left). 2026-02-05 17:11:12,670 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (21 retries left). 2026-02-05 17:11:19,102 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (20 retries left). 2026-02-05 17:11:25,618 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (19 retries left). 2026-02-05 17:11:31,980 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (18 retries left). 2026-02-05 17:11:38,295 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (17 retries left). 2026-02-05 17:11:44,514 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (16 retries left). 2026-02-05 17:11:50,443 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (15 retries left). 2026-02-05 17:11:56,417 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (14 retries left). 2026-02-05 17:12:02,453 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (13 retries left). 2026-02-05 17:12:08,398 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (12 retries left). 2026-02-05 17:12:14,356 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (11 retries left). 2026-02-05 17:12:20,233 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (10 retries left). 2026-02-05 17:12:26,147 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (9 retries left). 2026-02-05 17:12:32,476 p=39250 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** 2026-02-05 17:12:32,477 p=39250 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:12:36,966 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). 2026-02-05 17:12:42,423 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). 2026-02-05 17:12:47,846 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). 2026-02-05 17:12:53,242 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). 2026-02-05 17:12:58,687 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). 2026-02-05 17:13:04,244 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). 2026-02-05 17:13:09,674 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). 2026-02-05 17:13:15,100 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). 2026-02-05 17:13:20,489 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). 2026-02-05 17:13:25,923 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). 2026-02-05 17:13:31,310 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). 2026-02-05 17:13:36,699 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). 2026-02-05 17:13:42,106 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). 2026-02-05 17:13:47,517 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). 2026-02-05 17:13:52,925 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). 2026-02-05 17:13:58,312 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). 2026-02-05 17:14:03,709 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). 2026-02-05 17:14:09,102 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). 2026-02-05 17:14:14,521 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). 2026-02-05 17:14:19,946 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). 2026-02-05 17:14:25,362 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). 2026-02-05 17:14:30,751 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). 2026-02-05 17:14:36,158 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). 2026-02-05 17:14:41,566 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). 2026-02-05 17:14:46,962 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). 2026-02-05 17:14:52,349 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). 2026-02-05 17:14:57,753 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). 2026-02-05 17:15:03,171 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). 2026-02-05 17:15:08,575 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). 2026-02-05 17:15:13,985 p=39250 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). 2026-02-05 17:15:19,391 p=39250 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** 2026-02-05 17:15:19,392 p=39250 u=1001930000 n=ansible ERROR| [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3 50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal) ^ column 3 2026-02-05 17:15:19,392 p=39250 u=1001930000 n=ansible INFO| fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-92 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.180371", "end": "2026-02-05 17:15:19.362467", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 17:15:19.182096", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} 2026-02-05 17:15:19,393 p=39250 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 17:15:19,393 p=39250 u=1001930000 n=ansible INFO| localhost : ok=20 changed=5 unreachable=0 failed=1 skipped=3 rescued=0 ignored=0 Run the command: oc get event -n test-oadp-92 2026/02/05 17:15:19 LAST SEEN TYPE REASON OBJECT MESSAGE 9m16s Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m16s Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m16s Normal Scheduled pod/cassandra-0 Successfully assigned test-oadp-92/cassandra-0 to ip-10-0-60-83.us-east-2.compute.internal 9m16s Normal SuccessfulAttachVolume pod/cassandra-0 AttachVolume.Attach succeeded for volume "pvc-9c848278-e349-499e-9db0-2925ed296404" 9m12s Normal AddedInterface pod/cassandra-0 Add eth0 [10.129.2.154/23] from ovn-kubernetes 2m48s Normal Pulling pod/cassandra-0 Pulling image "quay.io/migqe/cassandra:multiarch" 9m11s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 599ms (599ms including waiting). Image size: 307783610 bytes. 5m38s Normal Created pod/cassandra-0 Created container: cassandra 5m38s Normal Started pod/cassandra-0 Started container cassandra 9m4s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 753ms (753ms including waiting). Image size: 307783610 bytes. 2m42s Warning BackOff pod/cassandra-0 Back-off restarting failed container cassandra in pod cassandra-0_test-oadp-92(2061f717-413e-4d15-9c73-02af8e628837) 8m43s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 583ms (583ms including waiting). Image size: 307783610 bytes. 8m7s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 525ms (525ms including waiting). Image size: 307783610 bytes. 7m12s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 558ms (558ms including waiting). Image size: 307783610 bytes. 5m38s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 569ms (569ms including waiting). Image size: 307783610 bytes. 2m48s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 579ms (579ms including waiting). Image size: 307783610 bytes. 9m10s Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m10s Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m10s Normal Scheduled pod/cassandra-1 Successfully assigned test-oadp-92/cassandra-1 to ip-10-0-98-206.us-east-2.compute.internal 9m10s Normal SuccessfulAttachVolume pod/cassandra-1 AttachVolume.Attach succeeded for volume "pvc-44f2cc22-62d4-4752-8d95-cfd1d2323294" 9m8s Normal AddedInterface pod/cassandra-1 Add eth0 [10.131.0.81/23] from ovn-kubernetes 2m48s Normal Pulling pod/cassandra-1 Pulling image "quay.io/migqe/cassandra:multiarch" 9m7s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 765ms (766ms including waiting). Image size: 307783610 bytes. 5m43s Normal Created pod/cassandra-1 Created container: cassandra 5m43s Normal Started pod/cassandra-1 Started container cassandra 8m59s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 437ms (437ms including waiting). Image size: 307783610 bytes. 3m12s Warning BackOff pod/cassandra-1 Back-off restarting failed container cassandra in pod cassandra-1_test-oadp-92(a587fc95-e091-4564-aafd-046c4824bc6a) 8m41s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 414ms (414ms including waiting). Image size: 307783610 bytes. 8m12s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 609ms (609ms including waiting). Image size: 307783610 bytes. 7m21s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 394ms (394ms including waiting). Image size: 307783610 bytes. 5m43s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 384ms (384ms including waiting). Image size: 307783610 bytes. 2m48s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 488ms (488ms including waiting). Image size: 307783610 bytes. 9m6s Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m6s Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m6s Normal Scheduled pod/cassandra-2 Successfully assigned test-oadp-92/cassandra-2 to ip-10-0-7-38.us-east-2.compute.internal 9m6s Normal SuccessfulAttachVolume pod/cassandra-2 AttachVolume.Attach succeeded for volume "pvc-36e74570-4889-411d-92dd-4642e097eac6" 8m56s Normal AddedInterface pod/cassandra-2 Add eth0 [10.128.2.50/23] from ovn-kubernetes 3m Normal Pulling pod/cassandra-2 Pulling image "quay.io/migqe/cassandra:multiarch" 8m55s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 540ms (540ms including waiting). Image size: 307783610 bytes. 5m46s Normal Created pod/cassandra-2 Created container: cassandra 5m46s Normal Started pod/cassandra-2 Started container cassandra 8m50s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 467ms (467ms including waiting). Image size: 307783610 bytes. 2m39s Warning BackOff pod/cassandra-2 Back-off restarting failed container cassandra in pod cassandra-2_test-oadp-92(7facd60c-d90f-4ef1-84d5-93f2c7afbc13) 8m32s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 516ms (516ms including waiting). Image size: 307783610 bytes. 8m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 698ms (698ms including waiting). Image size: 307783610 bytes. 7m14s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 552ms (552ms including waiting). Image size: 307783610 bytes. 5m46s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 784ms (784ms including waiting). Image size: 307783610 bytes. 2m59s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 894ms (894ms including waiting). Image size: 307783610 bytes. 9m17s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-0 External provisioner is provisioning volume for claim "test-oadp-92/cassandra-data-cassandra-0" 9m17s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-0 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 9m17s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-0 Successfully provisioned volume pvc-9c848278-e349-499e-9db0-2925ed296404 9m11s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-1 External provisioner is provisioning volume for claim "test-oadp-92/cassandra-data-cassandra-1" 9m11s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-1 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 9m11s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-1 Successfully provisioned volume pvc-44f2cc22-62d4-4752-8d95-cfd1d2323294 9m6s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-2 External provisioner is provisioning volume for claim "test-oadp-92/cassandra-data-cassandra-2" 9m6s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-2 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 9m6s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-2 Successfully provisioned volume pvc-36e74570-4889-411d-92dd-4642e097eac6 9m17s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-0 Pod cassandra-0 in StatefulSet cassandra success 9m17s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-0 in StatefulSet cassandra successful 9m11s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-1 Pod cassandra-1 in StatefulSet cassandra success 9m11s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-1 in StatefulSet cassandra successful 9m6s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-2 Pod cassandra-2 in StatefulSet cassandra success 9m6s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-2 in StatefulSet cassandra successful 2026/02/05 17:15:19 Found server error pattern in ansible logs: '502' 2026/02/05 17:15:19 Detected server errors in ansible logs - treating as retryable 2026/02/05 17:15:19 ⚠️ Operation 'Deploy application ocp-cassandra' failed with retryable server error (attempt 2/3): Error during command execution: ansible-playbook error: one or more host failed Command executed: /usr/local/bin/ansible-playbook --extra-vars {"admin_kubeconfig":"/home/jenkins/.kube/config","namespace":"test-oadp-92","non_admin_user":false,"use_role":"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra","user_kubeconfig":"/home/jenkins/.kube/config","with_deploy":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml exit status 2 2026/02/05 17:15:19 🕐 Waiting 2m0s before retry... 2026/02/05 17:17:19 🔄 [Attempt 3/3] Executing operation: Deploy application ocp-cassandra 2026/02/05 17:17:19 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** ok: [localhost] [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** ok: [localhost] FAILED - RETRYING: [localhost]: Check pods status (30 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** ok: [localhost] FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3  50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal)  ^ column 3  fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-92 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.174616", "end": "2026-02-05 17:20:23.230776", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 17:20:23.056160", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} PLAY RECAP ********************************************************************* localhost : ok=20  changed=5  unreachable=0 failed=1  skipped=3  rescued=0 ignored=0 2026/02/05 17:20:23 2026-02-05 17:17:21,610 p=40846 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 17:17:21,610 p=40846 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:17:22,102 p=40846 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 17:17:22,103 p=40846 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:17:22,523 p=40846 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 17:17:22,523 p=40846 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:17:22,858 p=40846 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 17:17:22,859 p=40846 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:17:22,879 p=40846 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 17:17:22,879 p=40846 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 17:17:22,879 p=40846 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:17:22,903 p=40846 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 17:17:22,903 p=40846 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:17:22,918 p=40846 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 17:17:22,919 p=40846 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 17:17:23,387 p=40846 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 17:17:23,388 p=40846 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 17:17:23,388 p=40846 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 17:17:23,389 p=40846 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:17:23,438 p=40846 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 17:17:23,438 p=40846 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:17:23,475 p=40846 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 17:17:23,476 p=40846 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:17:23,481 p=40846 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 17:17:24,271 p=40846 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 17:17:24,271 p=40846 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:17:25,628 p=40846 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** 2026-02-05 17:17:25,628 p=40846 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 17:17:25,628 p=40846 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:17:25,628 p=40846 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:17:25,629 p=40846 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:17:25,629 p=40846 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:17:26,049 p=40846 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** 2026-02-05 17:17:26,049 p=40846 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:17:27,476 p=40846 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** 2026-02-05 17:17:27,477 p=40846 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:17:28,726 p=40846 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** 2026-02-05 17:17:28,727 p=40846 u=1001930000 n=ansible WARNING| [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" 2026-02-05 17:17:28,727 p=40846 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. 2026-02-05 17:17:28,727 p=40846 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:17:29,917 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (30 retries left). 2026-02-05 17:17:36,084 p=40846 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** 2026-02-05 17:17:36,085 p=40846 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:17:36,577 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). 2026-02-05 17:17:42,174 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). 2026-02-05 17:17:47,744 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). 2026-02-05 17:17:54,436 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). 2026-02-05 17:18:00,067 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). 2026-02-05 17:18:05,853 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). 2026-02-05 17:18:11,664 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). 2026-02-05 17:18:17,456 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). 2026-02-05 17:18:23,236 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). 2026-02-05 17:18:28,699 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). 2026-02-05 17:18:34,149 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). 2026-02-05 17:18:39,721 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). 2026-02-05 17:18:45,215 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). 2026-02-05 17:18:50,778 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). 2026-02-05 17:18:56,248 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). 2026-02-05 17:19:01,928 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). 2026-02-05 17:19:07,364 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). 2026-02-05 17:19:12,850 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). 2026-02-05 17:19:18,253 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). 2026-02-05 17:19:23,659 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). 2026-02-05 17:19:29,114 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). 2026-02-05 17:19:34,537 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). 2026-02-05 17:19:39,956 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). 2026-02-05 17:19:45,365 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). 2026-02-05 17:19:50,773 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). 2026-02-05 17:19:56,189 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). 2026-02-05 17:20:01,589 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). 2026-02-05 17:20:06,995 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). 2026-02-05 17:20:12,448 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). 2026-02-05 17:20:17,840 p=40846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). 2026-02-05 17:20:23,257 p=40846 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** 2026-02-05 17:20:23,258 p=40846 u=1001930000 n=ansible ERROR| [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3 50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal) ^ column 3 2026-02-05 17:20:23,258 p=40846 u=1001930000 n=ansible INFO| fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-92 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.174616", "end": "2026-02-05 17:20:23.230776", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 17:20:23.056160", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} 2026-02-05 17:20:23,259 p=40846 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 17:20:23,259 p=40846 u=1001930000 n=ansible INFO| localhost : ok=20 changed=5 unreachable=0 failed=1 skipped=3 rescued=0 ignored=0 Run the command: oc get event -n test-oadp-92 2026/02/05 17:20:23 LAST SEEN TYPE REASON OBJECT MESSAGE 14m Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Normal Scheduled pod/cassandra-0 Successfully assigned test-oadp-92/cassandra-0 to ip-10-0-60-83.us-east-2.compute.internal 14m Normal SuccessfulAttachVolume pod/cassandra-0 AttachVolume.Attach succeeded for volume "pvc-9c848278-e349-499e-9db0-2925ed296404" 14m Normal AddedInterface pod/cassandra-0 Add eth0 [10.129.2.154/23] from ovn-kubernetes 2m36s Normal Pulling pod/cassandra-0 Pulling image "quay.io/migqe/cassandra:multiarch" 14m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 599ms (599ms including waiting). Image size: 307783610 bytes. 10m Normal Created pod/cassandra-0 Created container: cassandra 10m Normal Started pod/cassandra-0 Started container cassandra 14m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 753ms (753ms including waiting). Image size: 307783610 bytes. 3m54s Warning BackOff pod/cassandra-0 Back-off restarting failed container cassandra in pod cassandra-0_test-oadp-92(2061f717-413e-4d15-9c73-02af8e628837) 13m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 583ms (583ms including waiting). Image size: 307783610 bytes. 13m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 525ms (525ms including waiting). Image size: 307783610 bytes. 12m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 558ms (558ms including waiting). Image size: 307783610 bytes. 10m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 569ms (569ms including waiting). Image size: 307783610 bytes. 7m52s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 579ms (579ms including waiting). Image size: 307783610 bytes. 14m Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Normal Scheduled pod/cassandra-1 Successfully assigned test-oadp-92/cassandra-1 to ip-10-0-98-206.us-east-2.compute.internal 14m Normal SuccessfulAttachVolume pod/cassandra-1 AttachVolume.Attach succeeded for volume "pvc-44f2cc22-62d4-4752-8d95-cfd1d2323294" 14m Normal AddedInterface pod/cassandra-1 Add eth0 [10.131.0.81/23] from ovn-kubernetes 2m34s Normal Pulling pod/cassandra-1 Pulling image "quay.io/migqe/cassandra:multiarch" 14m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 765ms (766ms including waiting). Image size: 307783610 bytes. 10m Normal Created pod/cassandra-1 Created container: cassandra 10m Normal Started pod/cassandra-1 Started container cassandra 14m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 437ms (437ms including waiting). Image size: 307783610 bytes. 3m48s Warning BackOff pod/cassandra-1 Back-off restarting failed container cassandra in pod cassandra-1_test-oadp-92(a587fc95-e091-4564-aafd-046c4824bc6a) 13m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 414ms (414ms including waiting). Image size: 307783610 bytes. 13m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 609ms (609ms including waiting). Image size: 307783610 bytes. 12m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 394ms (394ms including waiting). Image size: 307783610 bytes. 10m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 384ms (384ms including waiting). Image size: 307783610 bytes. 7m52s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 488ms (488ms including waiting). Image size: 307783610 bytes. 14m Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Normal Scheduled pod/cassandra-2 Successfully assigned test-oadp-92/cassandra-2 to ip-10-0-7-38.us-east-2.compute.internal 14m Normal SuccessfulAttachVolume pod/cassandra-2 AttachVolume.Attach succeeded for volume "pvc-36e74570-4889-411d-92dd-4642e097eac6" 14m Normal AddedInterface pod/cassandra-2 Add eth0 [10.128.2.50/23] from ovn-kubernetes 2m49s Normal Pulling pod/cassandra-2 Pulling image "quay.io/migqe/cassandra:multiarch" 13m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 540ms (540ms including waiting). Image size: 307783610 bytes. 10m Normal Created pod/cassandra-2 Created container: cassandra 10m Normal Started pod/cassandra-2 Started container cassandra 13m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 467ms (467ms including waiting). Image size: 307783610 bytes. 3m38s Warning BackOff pod/cassandra-2 Back-off restarting failed container cassandra in pod cassandra-2_test-oadp-92(7facd60c-d90f-4ef1-84d5-93f2c7afbc13) 13m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 516ms (516ms including waiting). Image size: 307783610 bytes. 13m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 698ms (698ms including waiting). Image size: 307783610 bytes. 12m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 552ms (552ms including waiting). Image size: 307783610 bytes. 10m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 784ms (784ms including waiting). Image size: 307783610 bytes. 8m3s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 894ms (894ms including waiting). Image size: 307783610 bytes. 14m Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-0 External provisioner is provisioning volume for claim "test-oadp-92/cassandra-data-cassandra-0" 14m Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-0 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 14m Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-0 Successfully provisioned volume pvc-9c848278-e349-499e-9db0-2925ed296404 14m Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-1 External provisioner is provisioning volume for claim "test-oadp-92/cassandra-data-cassandra-1" 14m Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-1 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 14m Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-1 Successfully provisioned volume pvc-44f2cc22-62d4-4752-8d95-cfd1d2323294 14m Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-2 External provisioner is provisioning volume for claim "test-oadp-92/cassandra-data-cassandra-2" 14m Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-2 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 14m Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-2 Successfully provisioned volume pvc-36e74570-4889-411d-92dd-4642e097eac6 14m Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-0 Pod cassandra-0 in StatefulSet cassandra success 14m Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-0 in StatefulSet cassandra successful 14m Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-1 Pod cassandra-1 in StatefulSet cassandra success 14m Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-1 in StatefulSet cassandra successful 14m Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-2 Pod cassandra-2 in StatefulSet cassandra success 14m Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-2 in StatefulSet cassandra successful 2026/02/05 17:20:23 Found server error pattern in ansible logs: '502' 2026/02/05 17:20:23 Detected server errors in ansible logs - treating as retryable 2026/02/05 17:20:23 ❌ Operation 'Deploy application ocp-cassandra' failed after 3 attempts. Final error: Error during command execution: ansible-playbook error: one or more host failed Command executed: /usr/local/bin/ansible-playbook --extra-vars {"admin_kubeconfig":"/home/jenkins/.kube/config","namespace":"test-oadp-92","non_admin_user":false,"use_role":"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra","user_kubeconfig":"/home/jenkins/.kube/config","with_deploy":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml exit status 2 [FAILED] in [It] - /alabama/cspi/test_common/backup_restore_app_case.go:49 @ 02/05/26 17:20:23.449 < Exit [It] [tc-id:OADP-92][interop][smoke] [Tier0] [vf:backup-hooks] Cassandra app with Restic @ 02/05/26 17:20:23.449 (14m38.935s) > Enter [JustAfterEach] TOP-LEVEL @ 02/05/26 17:20:23.449 2026/02/05 17:20:23 Using Must-gather image: registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 STEP: Get the failed spec name @ 02/05/26 17:20:23.45 2026/02/05 17:20:23 The failed spec name is: Backup hooks tests Pre exec hook [tc-id:OADP-92][interop][smoke] [Tier0] [vf:backup-hooks] Cassandra app with Restic STEP: Create a folder for all must-gather files if it doesn't exists already @ 02/05/26 17:20:23.45 STEP: Create a folder for the failed spec if it doesn't exists already @ 02/05/26 17:20:23.45 STEP: Run must-gather because the spec failed @ 02/05/26 17:20:23.45 2026/02/05 17:20:23 Log the present working directory path:- /alabama/cspi/e2e 2026/02/05 17:20:23 [adm must-gather --dest-dir /alabama/cspi/e2e/logs/It_Backup_hooks_tests_Pre_exec_hook_tc-id_OADP-92_interop_smoke_Tier0_vf_backup-hooks_Cassandra_app_with_Restic --image registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3] 2026/02/05 17:20:42 Log all the files present in /alabama/cspi/e2e/logs directory 2026/02/05 17:20:42 It_Backup_hooks_tests_Pre_exec_hook_tc-id_OADP-92_interop_smoke_Tier0_vf_backup-hooks_Cassandra_app_with_Restic STEP: Find must-gather folder and rename it to a shorter more readable name @ 02/05/26 17:20:42.03 The folder logs/It_Backup_hooks_tests_Pre_exec_hook_tc-id_OADP-92_interop_smoke_Tier0_vf_backup-hooks_Cassandra_app_with_Restic/must-gather already exists, skipping renaming the folder Secret deletion flag: true Deleting cloud credentials secret cloud-credentials in namespace openshift-adp < Exit [JustAfterEach] TOP-LEVEL @ 02/05/26 17:20:42.049 (18.6s) > Enter [DeferCleanup (Each)] Pre exec hook @ 02/05/26 17:20:42.049 2026/02/05 17:20:42 Cleaning app 2026/02/05 17:20:42 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Remove namespace test-oadp-92] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=16  changed=5  unreachable=0 failed=0 skipped=22  rescued=0 ignored=0 2026/02/05 17:21:12 2026-02-05 17:20:43,792 p=42135 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 17:20:43,793 p=42135 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:20:44,122 p=42135 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 17:20:44,122 p=42135 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:20:44,463 p=42135 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 17:20:44,463 p=42135 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:20:44,814 p=42135 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 17:20:44,814 p=42135 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:20:44,832 p=42135 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 17:20:44,832 p=42135 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 17:20:44,832 p=42135 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:20:44,856 p=42135 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 17:20:44,856 p=42135 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:20:44,871 p=42135 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 17:20:44,871 p=42135 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 17:20:45,329 p=42135 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 17:20:45,330 p=42135 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 17:20:45,330 p=42135 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 17:20:45,330 p=42135 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:20:45,361 p=42135 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 17:20:45,361 p=42135 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:20:45,384 p=42135 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 17:20:45,384 p=42135 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:20:45,387 p=42135 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 17:20:46,001 p=42135 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 17:20:46,001 p=42135 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:21:12,186 p=42135 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Remove namespace test-oadp-92] *** 2026-02-05 17:21:12,187 p=42135 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 17:21:12,187 p=42135 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:21:12,187 p=42135 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:21:12,188 p=42135 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:21:12,188 p=42135 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:21:12,580 p=42135 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 17:21:12,580 p=42135 u=1001930000 n=ansible INFO| localhost : ok=16 changed=5 unreachable=0 failed=0 skipped=22 rescued=0 ignored=0 < Exit [DeferCleanup (Each)] Pre exec hook @ 02/05/26 17:21:12.642 (30.593s) > Enter [DeferCleanup (Each)] Pre exec hook @ 02/05/26 17:21:12.642 2026/02/05 17:21:12 Cleaning setup resources for the backup < Exit [DeferCleanup (Each)] Pre exec hook @ 02/05/26 17:21:12.642 (0s) > Enter [DeferCleanup (Each)] Pre exec hook @ 02/05/26 17:21:12.642 2026/02/05 17:21:12 Deleting DPA CR < Exit [DeferCleanup (Each)] Pre exec hook @ 02/05/26 17:21:12.654 (12ms) Attempt #2 Failed. Retrying ↺ @ 02/05/26 17:21:12.654 > Enter [BeforeEach] TOP-LEVEL @ 02/05/26 17:21:12.654 < Exit [BeforeEach] TOP-LEVEL @ 02/05/26 17:21:12.654 (0s) > Enter [BeforeEach] Backup hooks tests @ 02/05/26 17:21:12.654 < Exit [BeforeEach] Backup hooks tests @ 02/05/26 17:21:12.662 (8ms) > Enter [JustBeforeEach] TOP-LEVEL @ 02/05/26 17:21:12.662 < Exit [JustBeforeEach] TOP-LEVEL @ 02/05/26 17:21:12.662 (0s) > Enter [It] [tc-id:OADP-92][interop][smoke] [Tier0] [vf:backup-hooks] Cassandra app with Restic @ 02/05/26 17:21:12.662 2026/02/05 17:21:12 Delete all downloadrequest ocp-datavolume-5d53c5a8-02b2-11f1-a828-0a58ac1896e8-125c3fd2-1934-4e0e-a2de-4f3407ca4189 ocp-datavolume-5d53c5a8-02b2-11f1-a828-0a58ac1896e8-b7ba0afb-2101-4c3f-a7b7-268e78a2ea24 STEP: Create DPA CR @ 02/05/26 17:21:12.803 2026/02/05 17:21:12 restic 2026/02/05 17:21:12 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "0b1003c0-498d-4192-b159-fca8b3534b3f", "resourceVersion": "123634", "generation": 1, "creationTimestamp": "2026-02-05T17:21:12Z", "managedFields": [ { "manager": "e2e.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T17:21:12Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:nodeAgent": { ".": {}, "f:enable": {}, "f:podConfig": { ".": {}, "f:resourceAllocations": {} }, "f:uploaderType": {} }, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift" ], "disableFsBackup": false }, "nodeAgent": { "enable": true, "podConfig": { "resourceAllocations": {} }, "uploaderType": "restic" } }, "features": null, "logFormat": "text" }, "status": {} } Delete all the backups that remained in the phase InProgress Deleting backup CRs in progress Deletion of backup CRs in progress completed Delete all the restores that remained in the phase InProgress Deleting restore CRs in progress Deletion of restore CRs in progress completed STEP: Verify DPA CR setup @ 02/05/26 17:21:12.842 2026/02/05 17:21:12 Waiting for velero pod to be running 2026/02/05 17:21:12 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete' 2026/02/05 17:21:12 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "0b1003c0-498d-4192-b159-fca8b3534b3f", "resourceVersion": "123634", "generation": 1, "creationTimestamp": "2026-02-05T17:21:12Z", "managedFields": [ { "manager": "e2e.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T17:21:12Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:nodeAgent": { ".": {}, "f:enable": {}, "f:podConfig": { ".": {}, "f:resourceAllocations": {} }, "f:uploaderType": {} }, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift" ], "disableFsBackup": false }, "nodeAgent": { "enable": true, "podConfig": { "resourceAllocations": {} }, "uploaderType": "restic" } }, "features": null, "logFormat": "text" }, "status": {} } 2026/02/05 17:21:17 DPA successfully reconciled STEP: Prepare backup resources, depending on the volumes backup type @ 02/05/26 17:21:17.877 2026/02/05 17:21:17 Checking for correct number of running NodeAgent pods... STEP: Installing application for case cassandra-hooks-e2e @ 02/05/26 17:21:17.89 2026/02/05 17:21:17 🔄 [Attempt 1/3] Executing operation: Deploy application ocp-cassandra 2026/02/05 17:21:17 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create namespace] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** changed: [localhost] [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** changed: [localhost] FAILED - RETRYING: [localhost]: Check pods status (30 retries left). FAILED - RETRYING: [localhost]: Check pods status (29 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** ok: [localhost] FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3  50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal)  ^ column 3  fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-92 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.188176", "end": "2026-02-05 17:24:37.708360", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 17:24:37.520184", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} PLAY RECAP ********************************************************************* localhost : ok=21  changed=8  unreachable=0 failed=1  skipped=2  rescued=0 ignored=0 2026/02/05 17:24:37 2026-02-05 17:21:19,811 p=42366 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 17:21:19,811 p=42366 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:21:20,144 p=42366 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 17:21:20,144 p=42366 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:21:20,494 p=42366 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 17:21:20,494 p=42366 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:21:20,880 p=42366 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 17:21:20,880 p=42366 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:21:20,899 p=42366 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 17:21:20,900 p=42366 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 17:21:20,900 p=42366 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:21:20,924 p=42366 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 17:21:20,925 p=42366 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:21:20,941 p=42366 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 17:21:20,941 p=42366 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 17:21:21,377 p=42366 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 17:21:21,378 p=42366 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 17:21:21,378 p=42366 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 17:21:21,378 p=42366 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:21:21,409 p=42366 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 17:21:21,409 p=42366 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:21:21,432 p=42366 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 17:21:21,432 p=42366 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:21:21,435 p=42366 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 17:21:22,111 p=42366 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 17:21:22,112 p=42366 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:21:23,274 p=42366 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** 2026-02-05 17:21:23,275 p=42366 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 17:21:23,275 p=42366 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:21:23,275 p=42366 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:21:23,275 p=42366 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:21:23,275 p=42366 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:21:23,755 p=42366 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create namespace] *** 2026-02-05 17:21:23,755 p=42366 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:21:24,153 p=42366 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** 2026-02-05 17:21:24,153 p=42366 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:21:25,378 p=42366 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** 2026-02-05 17:21:25,379 p=42366 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:21:26,429 p=42366 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** 2026-02-05 17:21:26,429 p=42366 u=1001930000 n=ansible WARNING| [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" 2026-02-05 17:21:26,430 p=42366 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. 2026-02-05 17:21:26,430 p=42366 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:21:27,460 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (30 retries left). 2026-02-05 17:21:33,414 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (29 retries left). 2026-02-05 17:21:39,422 p=42366 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** 2026-02-05 17:21:39,422 p=42366 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:21:43,634 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). 2026-02-05 17:21:51,129 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). 2026-02-05 17:21:56,529 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). 2026-02-05 17:22:01,944 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). 2026-02-05 17:22:08,828 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). 2026-02-05 17:22:14,236 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). 2026-02-05 17:22:19,663 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). 2026-02-05 17:22:25,089 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). 2026-02-05 17:22:30,579 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). 2026-02-05 17:22:38,733 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). 2026-02-05 17:22:44,266 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). 2026-02-05 17:22:49,787 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). 2026-02-05 17:22:55,444 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). 2026-02-05 17:23:00,890 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). 2026-02-05 17:23:06,568 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). 2026-02-05 17:23:12,222 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). 2026-02-05 17:23:17,810 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). 2026-02-05 17:23:23,556 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). 2026-02-05 17:23:31,438 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). 2026-02-05 17:23:36,883 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). 2026-02-05 17:23:42,336 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). 2026-02-05 17:23:47,766 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). 2026-02-05 17:23:53,194 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). 2026-02-05 17:23:58,647 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). 2026-02-05 17:24:04,239 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). 2026-02-05 17:24:09,697 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). 2026-02-05 17:24:15,376 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). 2026-02-05 17:24:20,985 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). 2026-02-05 17:24:26,629 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). 2026-02-05 17:24:32,273 p=42366 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). 2026-02-05 17:24:37,738 p=42366 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** 2026-02-05 17:24:37,738 p=42366 u=1001930000 n=ansible ERROR| [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3 50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal) ^ column 3 2026-02-05 17:24:37,739 p=42366 u=1001930000 n=ansible INFO| fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-92 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.188176", "end": "2026-02-05 17:24:37.708360", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 17:24:37.520184", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} 2026-02-05 17:24:37,740 p=42366 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 17:24:37,740 p=42366 u=1001930000 n=ansible INFO| localhost : ok=21 changed=8 unreachable=0 failed=1 skipped=2 rescued=0 ignored=0 Run the command: oc get event -n test-oadp-92 2026/02/05 17:24:37 LAST SEEN TYPE REASON OBJECT MESSAGE 3m11s Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 3m11s Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 3m11s Normal Scheduled pod/cassandra-0 Successfully assigned test-oadp-92/cassandra-0 to ip-10-0-60-83.us-east-2.compute.internal 3m10s Normal SuccessfulAttachVolume pod/cassandra-0 AttachVolume.Attach succeeded for volume "pvc-8990d50f-88eb-4340-8af1-fe409f75e46c" 3m1s Normal AddedInterface pod/cassandra-0 Add eth0 [10.129.2.172/23] from ovn-kubernetes 72s Normal Pulling pod/cassandra-0 Pulling image "quay.io/migqe/cassandra:multiarch" 3m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 656ms (656ms including waiting). Image size: 307783610 bytes. 72s Normal Created pod/cassandra-0 Created container: cassandra 72s Normal Started pod/cassandra-0 Started container cassandra 2m53s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 534ms (534ms including waiting). Image size: 307783610 bytes. 9s Warning BackOff pod/cassandra-0 Back-off restarting failed container cassandra in pod cassandra-0_test-oadp-92(30450e3b-c59c-4a9b-a97f-bbb46835680e) 2m35s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 459ms (459ms including waiting). Image size: 307783610 bytes. 2m5s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 627ms (627ms including waiting). Image size: 307783610 bytes. 72s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 489ms (489ms including waiting). Image size: 307783610 bytes. 2m59s Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 2m59s Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 2m59s Normal Scheduled pod/cassandra-1 Successfully assigned test-oadp-92/cassandra-1 to ip-10-0-98-206.us-east-2.compute.internal 2m58s Normal SuccessfulAttachVolume pod/cassandra-1 AttachVolume.Attach succeeded for volume "pvc-f9f386f9-6da0-4be0-a4b9-93b89ad3fe93" 2m57s Normal AddedInterface pod/cassandra-1 Add eth0 [10.131.0.84/23] from ovn-kubernetes 63s Normal Pulling pod/cassandra-1 Pulling image "quay.io/migqe/cassandra:multiarch" 2m57s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 429ms (429ms including waiting). Image size: 307783610 bytes. 62s Normal Created pod/cassandra-1 Created container: cassandra 62s Normal Started pod/cassandra-1 Started container cassandra 2m51s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 439ms (439ms including waiting). Image size: 307783610 bytes. 6s Warning BackOff pod/cassandra-1 Back-off restarting failed container cassandra in pod cassandra-1_test-oadp-92(130d88e2-f54e-4a0f-9d59-7f509d0a393b) 2m32s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 424ms (424ms including waiting). Image size: 307783610 bytes. 2m3s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 415ms (415ms including waiting). Image size: 307783610 bytes. 62s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 1.1s (1.1s including waiting). Image size: 307783610 bytes. 2m56s Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 2m55s Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 2m55s Normal Scheduled pod/cassandra-2 Successfully assigned test-oadp-92/cassandra-2 to ip-10-0-7-38.us-east-2.compute.internal 2m55s Normal SuccessfulAttachVolume pod/cassandra-2 AttachVolume.Attach succeeded for volume "pvc-1dc446cd-4e04-4e86-b72b-6320387cda65" 2m44s Normal AddedInterface pod/cassandra-2 Add eth0 [10.128.2.52/23] from ovn-kubernetes 55s Normal Pulling pod/cassandra-2 Pulling image "quay.io/migqe/cassandra:multiarch" 2m44s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 560ms (560ms including waiting). Image size: 307783610 bytes. 55s Normal Created pod/cassandra-2 Created container: cassandra 55s Normal Started pod/cassandra-2 Started container cassandra 2m38s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 441ms (441ms including waiting). Image size: 307783610 bytes. 8s Warning BackOff pod/cassandra-2 Back-off restarting failed container cassandra in pod cassandra-2_test-oadp-92(ca0642c1-ae88-42ee-a0e0-fc6d393eddbd) 2m19s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 536ms (536ms including waiting). Image size: 307783610 bytes. 108s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 725ms (725ms including waiting). Image size: 307783610 bytes. 55s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 479ms (479ms including waiting). Image size: 307783610 bytes. 3m11s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-0 External provisioner is provisioning volume for claim "test-oadp-92/cassandra-data-cassandra-0" 3m11s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-0 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 3m11s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-0 Successfully provisioned volume pvc-8990d50f-88eb-4340-8af1-fe409f75e46c 2m59s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-1 External provisioner is provisioning volume for claim "test-oadp-92/cassandra-data-cassandra-1" 2m59s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-1 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 2m59s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-1 Successfully provisioned volume pvc-f9f386f9-6da0-4be0-a4b9-93b89ad3fe93 2m56s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-2 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 2m56s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-2 External provisioner is provisioning volume for claim "test-oadp-92/cassandra-data-cassandra-2" 2m55s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-2 Successfully provisioned volume pvc-1dc446cd-4e04-4e86-b72b-6320387cda65 3m11s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-0 Pod cassandra-0 in StatefulSet cassandra success 3m11s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-0 in StatefulSet cassandra successful 2m59s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-1 Pod cassandra-1 in StatefulSet cassandra success 2m59s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-1 in StatefulSet cassandra successful 2m56s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-2 Pod cassandra-2 in StatefulSet cassandra success 2m56s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-2 in StatefulSet cassandra successful 2026/02/05 17:24:37 Found server error pattern in ansible logs: '502' 2026/02/05 17:24:37 Detected server errors in ansible logs - treating as retryable 2026/02/05 17:24:37 ⚠️ Operation 'Deploy application ocp-cassandra' failed with retryable server error (attempt 1/3): Error during command execution: ansible-playbook error: one or more host failed Command executed: /usr/local/bin/ansible-playbook --extra-vars {"admin_kubeconfig":"/home/jenkins/.kube/config","namespace":"test-oadp-92","non_admin_user":false,"use_role":"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra","user_kubeconfig":"/home/jenkins/.kube/config","with_deploy":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml exit status 2 2026/02/05 17:24:37 🕐 Waiting 1m0s before retry... 2026/02/05 17:25:37 🔄 [Attempt 2/3] Executing operation: Deploy application ocp-cassandra 2026/02/05 17:25:37 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** ok: [localhost] [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** ok: [localhost] FAILED - RETRYING: [localhost]: Check pods status (30 retries left). FAILED - RETRYING: [localhost]: Check pods status (29 retries left). FAILED - RETRYING: [localhost]: Check pods status (28 retries left). FAILED - RETRYING: [localhost]: Check pods status (27 retries left). FAILED - RETRYING: [localhost]: Check pods status (26 retries left). FAILED - RETRYING: [localhost]: Check pods status (25 retries left). FAILED - RETRYING: [localhost]: Check pods status (24 retries left). FAILED - RETRYING: [localhost]: Check pods status (23 retries left). FAILED - RETRYING: [localhost]: Check pods status (22 retries left). FAILED - RETRYING: [localhost]: Check pods status (21 retries left). FAILED - RETRYING: [localhost]: Check pods status (20 retries left). FAILED - RETRYING: [localhost]: Check pods status (19 retries left). FAILED - RETRYING: [localhost]: Check pods status (18 retries left). FAILED - RETRYING: [localhost]: Check pods status (17 retries left). FAILED - RETRYING: [localhost]: Check pods status (16 retries left). FAILED - RETRYING: [localhost]: Check pods status (15 retries left). FAILED - RETRYING: [localhost]: Check pods status (14 retries left). FAILED - RETRYING: [localhost]: Check pods status (13 retries left). FAILED - RETRYING: [localhost]: Check pods status (12 retries left). FAILED - RETRYING: [localhost]: Check pods status (11 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** ok: [localhost] FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3  50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal)  ^ column 3  fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-92 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.174625", "end": "2026-02-05 17:30:32.363810", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 17:30:32.189185", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} PLAY RECAP ********************************************************************* localhost : ok=20  changed=5  unreachable=0 failed=1  skipped=3  rescued=0 ignored=0 2026/02/05 17:30:32 2026-02-05 17:25:39,700 p=43673 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 17:25:39,700 p=43673 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:25:40,040 p=43673 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 17:25:40,041 p=43673 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:25:40,366 p=43673 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 17:25:40,366 p=43673 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:25:40,695 p=43673 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 17:25:40,695 p=43673 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:25:40,715 p=43673 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 17:25:40,715 p=43673 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 17:25:40,715 p=43673 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:25:40,735 p=43673 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 17:25:40,735 p=43673 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:25:40,749 p=43673 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 17:25:40,750 p=43673 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 17:25:41,163 p=43673 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 17:25:41,164 p=43673 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 17:25:41,164 p=43673 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 17:25:41,164 p=43673 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:25:41,192 p=43673 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 17:25:41,193 p=43673 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:25:41,214 p=43673 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 17:25:41,215 p=43673 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:25:41,217 p=43673 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 17:25:41,837 p=43673 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 17:25:41,838 p=43673 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:25:42,953 p=43673 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** 2026-02-05 17:25:42,953 p=43673 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 17:25:42,954 p=43673 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:25:42,954 p=43673 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:25:42,954 p=43673 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:25:42,954 p=43673 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:25:43,350 p=43673 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** 2026-02-05 17:25:43,350 p=43673 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:25:44,501 p=43673 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** 2026-02-05 17:25:44,502 p=43673 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:25:45,528 p=43673 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** 2026-02-05 17:25:45,528 p=43673 u=1001930000 n=ansible WARNING| [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" 2026-02-05 17:25:45,529 p=43673 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. 2026-02-05 17:25:45,529 p=43673 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:25:46,530 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (30 retries left). 2026-02-05 17:25:52,487 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (29 retries left). 2026-02-05 17:25:58,416 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (28 retries left). 2026-02-05 17:26:04,385 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (27 retries left). 2026-02-05 17:26:10,310 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (26 retries left). 2026-02-05 17:26:16,248 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (25 retries left). 2026-02-05 17:26:22,207 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (24 retries left). 2026-02-05 17:26:28,210 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (23 retries left). 2026-02-05 17:26:34,248 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (22 retries left). 2026-02-05 17:26:40,232 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (21 retries left). 2026-02-05 17:26:46,137 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (20 retries left). 2026-02-05 17:26:52,077 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (19 retries left). 2026-02-05 17:26:57,992 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (18 retries left). 2026-02-05 17:27:03,909 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (17 retries left). 2026-02-05 17:27:09,833 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (16 retries left). 2026-02-05 17:27:15,762 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (15 retries left). 2026-02-05 17:27:21,715 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (14 retries left). 2026-02-05 17:27:27,695 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (13 retries left). 2026-02-05 17:27:33,668 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (12 retries left). 2026-02-05 17:27:39,677 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (11 retries left). 2026-02-05 17:27:45,601 p=43673 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** 2026-02-05 17:27:45,601 p=43673 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:27:50,034 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). 2026-02-05 17:27:55,451 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). 2026-02-05 17:28:00,862 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). 2026-02-05 17:28:06,265 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). 2026-02-05 17:28:11,675 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). 2026-02-05 17:28:17,084 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). 2026-02-05 17:28:22,522 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). 2026-02-05 17:28:27,960 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). 2026-02-05 17:28:33,451 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). 2026-02-05 17:28:38,859 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). 2026-02-05 17:28:44,252 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). 2026-02-05 17:28:49,720 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). 2026-02-05 17:28:55,133 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). 2026-02-05 17:29:00,594 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). 2026-02-05 17:29:06,016 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). 2026-02-05 17:29:11,425 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). 2026-02-05 17:29:16,832 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). 2026-02-05 17:29:22,227 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). 2026-02-05 17:29:27,611 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). 2026-02-05 17:29:33,005 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). 2026-02-05 17:29:38,390 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). 2026-02-05 17:29:43,783 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). 2026-02-05 17:29:49,183 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). 2026-02-05 17:29:54,572 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). 2026-02-05 17:29:59,970 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). 2026-02-05 17:30:05,387 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). 2026-02-05 17:30:10,773 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). 2026-02-05 17:30:16,161 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). 2026-02-05 17:30:21,534 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). 2026-02-05 17:30:26,956 p=43673 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). 2026-02-05 17:30:32,391 p=43673 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** 2026-02-05 17:30:32,392 p=43673 u=1001930000 n=ansible ERROR| [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3 50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal) ^ column 3 2026-02-05 17:30:32,393 p=43673 u=1001930000 n=ansible INFO| fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-92 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.174625", "end": "2026-02-05 17:30:32.363810", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 17:30:32.189185", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} 2026-02-05 17:30:32,394 p=43673 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 17:30:32,394 p=43673 u=1001930000 n=ansible INFO| localhost : ok=20 changed=5 unreachable=0 failed=1 skipped=3 rescued=0 ignored=0 Run the command: oc get event -n test-oadp-92 2026/02/05 17:30:32 LAST SEEN TYPE REASON OBJECT MESSAGE 9m6s Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m5s Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m5s Normal Scheduled pod/cassandra-0 Successfully assigned test-oadp-92/cassandra-0 to ip-10-0-60-83.us-east-2.compute.internal 9m5s Normal SuccessfulAttachVolume pod/cassandra-0 AttachVolume.Attach succeeded for volume "pvc-8990d50f-88eb-4340-8af1-fe409f75e46c" 8m56s Normal AddedInterface pod/cassandra-0 Add eth0 [10.129.2.172/23] from ovn-kubernetes 2m48s Normal Pulling pod/cassandra-0 Pulling image "quay.io/migqe/cassandra:multiarch" 8m55s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 656ms (656ms including waiting). Image size: 307783610 bytes. 5m37s Normal Created pod/cassandra-0 Created container: cassandra 5m37s Normal Started pod/cassandra-0 Started container cassandra 8m48s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 534ms (534ms including waiting). Image size: 307783610 bytes. 2m42s Warning BackOff pod/cassandra-0 Back-off restarting failed container cassandra in pod cassandra-0_test-oadp-92(30450e3b-c59c-4a9b-a97f-bbb46835680e) 8m30s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 459ms (459ms including waiting). Image size: 307783610 bytes. 8m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 627ms (627ms including waiting). Image size: 307783610 bytes. 7m7s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 489ms (489ms including waiting). Image size: 307783610 bytes. 5m38s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 606ms (606ms including waiting). Image size: 307783610 bytes. 2m48s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 581ms (581ms including waiting). Image size: 307783610 bytes. 8m54s Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 8m54s Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 8m54s Normal Scheduled pod/cassandra-1 Successfully assigned test-oadp-92/cassandra-1 to ip-10-0-98-206.us-east-2.compute.internal 8m53s Normal SuccessfulAttachVolume pod/cassandra-1 AttachVolume.Attach succeeded for volume "pvc-f9f386f9-6da0-4be0-a4b9-93b89ad3fe93" 8m52s Normal AddedInterface pod/cassandra-1 Add eth0 [10.131.0.84/23] from ovn-kubernetes 2m39s Normal Pulling pod/cassandra-1 Pulling image "quay.io/migqe/cassandra:multiarch" 8m52s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 429ms (429ms including waiting). Image size: 307783610 bytes. 5m24s Normal Created pod/cassandra-1 Created container: cassandra 5m24s Normal Started pod/cassandra-1 Started container cassandra 8m46s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 439ms (439ms including waiting). Image size: 307783610 bytes. 2m52s Warning BackOff pod/cassandra-1 Back-off restarting failed container cassandra in pod cassandra-1_test-oadp-92(130d88e2-f54e-4a0f-9d59-7f509d0a393b) 8m27s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 424ms (424ms including waiting). Image size: 307783610 bytes. 7m58s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 415ms (415ms including waiting). Image size: 307783610 bytes. 6m57s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 1.1s (1.1s including waiting). Image size: 307783610 bytes. 2m38s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 568ms (568ms including waiting). Image size: 307783610 bytes. 8m50s Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 8m50s Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 8m50s Normal Scheduled pod/cassandra-2 Successfully assigned test-oadp-92/cassandra-2 to ip-10-0-7-38.us-east-2.compute.internal 8m50s Normal SuccessfulAttachVolume pod/cassandra-2 AttachVolume.Attach succeeded for volume "pvc-1dc446cd-4e04-4e86-b72b-6320387cda65" 8m39s Normal AddedInterface pod/cassandra-2 Add eth0 [10.128.2.52/23] from ovn-kubernetes 2m33s Normal Pulling pod/cassandra-2 Pulling image "quay.io/migqe/cassandra:multiarch" 8m39s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 560ms (560ms including waiting). Image size: 307783610 bytes. 5m25s Normal Created pod/cassandra-2 Created container: cassandra 5m25s Normal Started pod/cassandra-2 Started container cassandra 8m33s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 441ms (441ms including waiting). Image size: 307783610 bytes. 2m45s Warning BackOff pod/cassandra-2 Back-off restarting failed container cassandra in pod cassandra-2_test-oadp-92(ca0642c1-ae88-42ee-a0e0-fc6d393eddbd) 8m14s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 536ms (536ms including waiting). Image size: 307783610 bytes. 7m43s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 725ms (725ms including waiting). Image size: 307783610 bytes. 6m50s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 479ms (479ms including waiting). Image size: 307783610 bytes. 5m25s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 473ms (473ms including waiting). Image size: 307783610 bytes. 2m33s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 408ms (408ms including waiting). Image size: 307783610 bytes. 9m6s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-0 External provisioner is provisioning volume for claim "test-oadp-92/cassandra-data-cassandra-0" 9m6s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-0 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 9m6s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-0 Successfully provisioned volume pvc-8990d50f-88eb-4340-8af1-fe409f75e46c 8m54s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-1 External provisioner is provisioning volume for claim "test-oadp-92/cassandra-data-cassandra-1" 8m54s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-1 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 8m54s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-1 Successfully provisioned volume pvc-f9f386f9-6da0-4be0-a4b9-93b89ad3fe93 8m51s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-2 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 8m51s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-2 External provisioner is provisioning volume for claim "test-oadp-92/cassandra-data-cassandra-2" 8m50s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-2 Successfully provisioned volume pvc-1dc446cd-4e04-4e86-b72b-6320387cda65 9m6s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-0 Pod cassandra-0 in StatefulSet cassandra success 9m6s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-0 in StatefulSet cassandra successful 8m54s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-1 Pod cassandra-1 in StatefulSet cassandra success 8m54s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-1 in StatefulSet cassandra successful 8m51s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-2 Pod cassandra-2 in StatefulSet cassandra success 8m51s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-2 in StatefulSet cassandra successful 2026/02/05 17:30:32 Found server error pattern in ansible logs: '502' 2026/02/05 17:30:32 Detected server errors in ansible logs - treating as retryable 2026/02/05 17:30:32 ⚠️ Operation 'Deploy application ocp-cassandra' failed with retryable server error (attempt 2/3): Error during command execution: ansible-playbook error: one or more host failed Command executed: /usr/local/bin/ansible-playbook --extra-vars {"admin_kubeconfig":"/home/jenkins/.kube/config","namespace":"test-oadp-92","non_admin_user":false,"use_role":"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra","user_kubeconfig":"/home/jenkins/.kube/config","with_deploy":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml exit status 2 2026/02/05 17:30:32 🕐 Waiting 2m0s before retry... 2026/02/05 17:32:32 🔄 [Attempt 3/3] Executing operation: Deploy application ocp-cassandra 2026/02/05 17:32:32 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** ok: [localhost] [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** ok: [localhost] FAILED - RETRYING: [localhost]: Check pods status (30 retries left). FAILED - RETRYING: [localhost]: Check pods status (29 retries left). FAILED - RETRYING: [localhost]: Check pods status (28 retries left). FAILED - RETRYING: [localhost]: Check pods status (27 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** ok: [localhost] FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3  50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal)  ^ column 3  fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-92 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.155384", "end": "2026-02-05 17:35:51.487935", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 17:35:51.332551", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} PLAY RECAP ********************************************************************* localhost : ok=20  changed=5  unreachable=0 failed=1  skipped=3  rescued=0 ignored=0 2026/02/05 17:35:51 2026-02-05 17:32:34,382 p=45242 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 17:32:34,383 p=45242 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:32:34,742 p=45242 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 17:32:34,742 p=45242 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:32:35,119 p=45242 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 17:32:35,119 p=45242 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:32:35,520 p=45242 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 17:32:35,521 p=45242 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:32:35,547 p=45242 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 17:32:35,548 p=45242 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 17:32:35,548 p=45242 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:32:35,578 p=45242 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 17:32:35,579 p=45242 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:32:35,597 p=45242 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 17:32:35,597 p=45242 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 17:32:36,124 p=45242 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 17:32:36,125 p=45242 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 17:32:36,125 p=45242 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 17:32:36,125 p=45242 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:32:36,157 p=45242 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 17:32:36,157 p=45242 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:32:36,187 p=45242 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 17:32:36,187 p=45242 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:32:36,191 p=45242 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 17:32:36,891 p=45242 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 17:32:36,892 p=45242 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:32:38,192 p=45242 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** 2026-02-05 17:32:38,192 p=45242 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 17:32:38,192 p=45242 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:32:38,193 p=45242 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:32:38,193 p=45242 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:32:38,193 p=45242 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:32:38,639 p=45242 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** 2026-02-05 17:32:38,640 p=45242 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:32:39,931 p=45242 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** 2026-02-05 17:32:39,932 p=45242 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:32:41,051 p=45242 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** 2026-02-05 17:32:41,052 p=45242 u=1001930000 n=ansible WARNING| [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" 2026-02-05 17:32:41,053 p=45242 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. 2026-02-05 17:32:41,053 p=45242 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:32:42,025 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (30 retries left). 2026-02-05 17:32:47,941 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (29 retries left). 2026-02-05 17:32:53,832 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (28 retries left). 2026-02-05 17:32:59,768 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (27 retries left). 2026-02-05 17:33:05,664 p=45242 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** 2026-02-05 17:33:05,665 p=45242 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:33:08,640 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). 2026-02-05 17:33:14,207 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). 2026-02-05 17:33:19,669 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). 2026-02-05 17:33:25,106 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). 2026-02-05 17:33:30,513 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). 2026-02-05 17:33:35,910 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). 2026-02-05 17:33:41,316 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). 2026-02-05 17:33:46,740 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). 2026-02-05 17:33:52,431 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). 2026-02-05 17:33:57,953 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). 2026-02-05 17:34:03,365 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). 2026-02-05 17:34:08,776 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). 2026-02-05 17:34:14,211 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). 2026-02-05 17:34:19,610 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). 2026-02-05 17:34:25,010 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). 2026-02-05 17:34:30,408 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). 2026-02-05 17:34:35,915 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). 2026-02-05 17:34:41,337 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). 2026-02-05 17:34:46,727 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). 2026-02-05 17:34:52,155 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). 2026-02-05 17:34:57,561 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). 2026-02-05 17:35:02,963 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). 2026-02-05 17:35:08,358 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). 2026-02-05 17:35:13,766 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). 2026-02-05 17:35:19,165 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). 2026-02-05 17:35:24,576 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). 2026-02-05 17:35:29,982 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). 2026-02-05 17:35:35,374 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). 2026-02-05 17:35:40,764 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). 2026-02-05 17:35:46,135 p=45242 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). 2026-02-05 17:35:51,516 p=45242 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** 2026-02-05 17:35:51,516 p=45242 u=1001930000 n=ansible ERROR| [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3 50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal) ^ column 3 2026-02-05 17:35:51,517 p=45242 u=1001930000 n=ansible INFO| fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-92 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.155384", "end": "2026-02-05 17:35:51.487935", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 17:35:51.332551", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} 2026-02-05 17:35:51,518 p=45242 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 17:35:51,518 p=45242 u=1001930000 n=ansible INFO| localhost : ok=20 changed=5 unreachable=0 failed=1 skipped=3 rescued=0 ignored=0 Run the command: oc get event -n test-oadp-92 2026/02/05 17:35:51 LAST SEEN TYPE REASON OBJECT MESSAGE 14m Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Normal Scheduled pod/cassandra-0 Successfully assigned test-oadp-92/cassandra-0 to ip-10-0-60-83.us-east-2.compute.internal 14m Normal SuccessfulAttachVolume pod/cassandra-0 AttachVolume.Attach succeeded for volume "pvc-8990d50f-88eb-4340-8af1-fe409f75e46c" 14m Normal AddedInterface pod/cassandra-0 Add eth0 [10.129.2.172/23] from ovn-kubernetes 2m49s Normal Pulling pod/cassandra-0 Pulling image "quay.io/migqe/cassandra:multiarch" 14m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 656ms (656ms including waiting). Image size: 307783610 bytes. 10m Normal Created pod/cassandra-0 Created container: cassandra 10m Normal Started pod/cassandra-0 Started container cassandra 14m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 534ms (534ms including waiting). Image size: 307783610 bytes. 3m54s Warning BackOff pod/cassandra-0 Back-off restarting failed container cassandra in pod cassandra-0_test-oadp-92(30450e3b-c59c-4a9b-a97f-bbb46835680e) 13m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 459ms (459ms including waiting). Image size: 307783610 bytes. 13m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 627ms (627ms including waiting). Image size: 307783610 bytes. 12m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 489ms (489ms including waiting). Image size: 307783610 bytes. 10m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 606ms (606ms including waiting). Image size: 307783610 bytes. 8m7s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 581ms (581ms including waiting). Image size: 307783610 bytes. 14m Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Normal Scheduled pod/cassandra-1 Successfully assigned test-oadp-92/cassandra-1 to ip-10-0-98-206.us-east-2.compute.internal 14m Normal SuccessfulAttachVolume pod/cassandra-1 AttachVolume.Attach succeeded for volume "pvc-f9f386f9-6da0-4be0-a4b9-93b89ad3fe93" 14m Normal AddedInterface pod/cassandra-1 Add eth0 [10.131.0.84/23] from ovn-kubernetes 2m49s Normal Pulling pod/cassandra-1 Pulling image "quay.io/migqe/cassandra:multiarch" 14m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 429ms (429ms including waiting). Image size: 307783610 bytes. 10m Normal Created pod/cassandra-1 Created container: cassandra 10m Normal Started pod/cassandra-1 Started container cassandra 14m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 439ms (439ms including waiting). Image size: 307783610 bytes. 3m57s Warning BackOff pod/cassandra-1 Back-off restarting failed container cassandra in pod cassandra-1_test-oadp-92(130d88e2-f54e-4a0f-9d59-7f509d0a393b) 13m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 424ms (424ms including waiting). Image size: 307783610 bytes. 13m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 415ms (415ms including waiting). Image size: 307783610 bytes. 12m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 1.1s (1.1s including waiting). Image size: 307783610 bytes. 7m57s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 568ms (568ms including waiting). Image size: 307783610 bytes. 14m Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Normal Scheduled pod/cassandra-2 Successfully assigned test-oadp-92/cassandra-2 to ip-10-0-7-38.us-east-2.compute.internal 14m Normal SuccessfulAttachVolume pod/cassandra-2 AttachVolume.Attach succeeded for volume "pvc-1dc446cd-4e04-4e86-b72b-6320387cda65" 13m Normal AddedInterface pod/cassandra-2 Add eth0 [10.128.2.52/23] from ovn-kubernetes 2m47s Normal Pulling pod/cassandra-2 Pulling image "quay.io/migqe/cassandra:multiarch" 13m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 560ms (560ms including waiting). Image size: 307783610 bytes. 10m Normal Created pod/cassandra-2 Created container: cassandra 10m Normal Started pod/cassandra-2 Started container cassandra 13m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 441ms (441ms including waiting). Image size: 307783610 bytes. 3m42s Warning BackOff pod/cassandra-2 Back-off restarting failed container cassandra in pod cassandra-2_test-oadp-92(ca0642c1-ae88-42ee-a0e0-fc6d393eddbd) 13m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 536ms (536ms including waiting). Image size: 307783610 bytes. 13m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 725ms (725ms including waiting). Image size: 307783610 bytes. 12m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 479ms (479ms including waiting). Image size: 307783610 bytes. 10m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 473ms (473ms including waiting). Image size: 307783610 bytes. 7m52s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 408ms (408ms including waiting). Image size: 307783610 bytes. 14m Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-0 External provisioner is provisioning volume for claim "test-oadp-92/cassandra-data-cassandra-0" 14m Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-0 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 14m Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-0 Successfully provisioned volume pvc-8990d50f-88eb-4340-8af1-fe409f75e46c 14m Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-1 External provisioner is provisioning volume for claim "test-oadp-92/cassandra-data-cassandra-1" 14m Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-1 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 14m Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-1 Successfully provisioned volume pvc-f9f386f9-6da0-4be0-a4b9-93b89ad3fe93 14m Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-2 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 14m Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-2 External provisioner is provisioning volume for claim "test-oadp-92/cassandra-data-cassandra-2" 14m Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-2 Successfully provisioned volume pvc-1dc446cd-4e04-4e86-b72b-6320387cda65 14m Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-0 Pod cassandra-0 in StatefulSet cassandra success 14m Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-0 in StatefulSet cassandra successful 14m Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-1 Pod cassandra-1 in StatefulSet cassandra success 14m Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-1 in StatefulSet cassandra successful 14m Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-2 Pod cassandra-2 in StatefulSet cassandra success 14m Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-2 in StatefulSet cassandra successful 2026/02/05 17:35:51 Found server error pattern in ansible logs: '502' 2026/02/05 17:35:51 Detected server errors in ansible logs - treating as retryable 2026/02/05 17:35:51 ❌ Operation 'Deploy application ocp-cassandra' failed after 3 attempts. Final error: Error during command execution: ansible-playbook error: one or more host failed Command executed: /usr/local/bin/ansible-playbook --extra-vars {"admin_kubeconfig":"/home/jenkins/.kube/config","namespace":"test-oadp-92","non_admin_user":false,"use_role":"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra","user_kubeconfig":"/home/jenkins/.kube/config","with_deploy":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml exit status 2 [FAILED] in [It] - /alabama/cspi/test_common/backup_restore_app_case.go:49 @ 02/05/26 17:35:51.692 < Exit [It] [tc-id:OADP-92][interop][smoke] [Tier0] [vf:backup-hooks] Cassandra app with Restic @ 02/05/26 17:35:51.692 (14m39.03s) > Enter [JustAfterEach] TOP-LEVEL @ 02/05/26 17:35:51.692 2026/02/05 17:35:51 Using Must-gather image: registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 STEP: Get the failed spec name @ 02/05/26 17:35:51.692 2026/02/05 17:35:51 The failed spec name is: Backup hooks tests Pre exec hook [tc-id:OADP-92][interop][smoke] [Tier0] [vf:backup-hooks] Cassandra app with Restic STEP: Create a folder for all must-gather files if it doesn't exists already @ 02/05/26 17:35:51.692 STEP: Create a folder for the failed spec if it doesn't exists already @ 02/05/26 17:35:51.692 STEP: Run must-gather because the spec failed @ 02/05/26 17:35:51.692 2026/02/05 17:35:51 Log the present working directory path:- /alabama/cspi/e2e 2026/02/05 17:35:51 [adm must-gather --dest-dir /alabama/cspi/e2e/logs/It_Backup_hooks_tests_Pre_exec_hook_tc-id_OADP-92_interop_smoke_Tier0_vf_backup-hooks_Cassandra_app_with_Restic --image registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3] 2026/02/05 17:36:09 Log all the files present in /alabama/cspi/e2e/logs directory 2026/02/05 17:36:09 It_Backup_hooks_tests_Pre_exec_hook_tc-id_OADP-92_interop_smoke_Tier0_vf_backup-hooks_Cassandra_app_with_Restic STEP: Find must-gather folder and rename it to a shorter more readable name @ 02/05/26 17:36:09.81 The folder logs/It_Backup_hooks_tests_Pre_exec_hook_tc-id_OADP-92_interop_smoke_Tier0_vf_backup-hooks_Cassandra_app_with_Restic/must-gather already exists, skipping renaming the folder Secret deletion flag: true Deleting cloud credentials secret cloud-credentials in namespace openshift-adp < Exit [JustAfterEach] TOP-LEVEL @ 02/05/26 17:36:09.822 (18.13s) > Enter [DeferCleanup (Each)] Pre exec hook @ 02/05/26 17:36:09.822 2026/02/05 17:36:09 Cleaning app 2026/02/05 17:36:09 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Remove namespace test-oadp-92] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=16  changed=5  unreachable=0 failed=0 skipped=22  rescued=0 ignored=0 2026/02/05 17:36:41 2026-02-05 17:36:11,645 p=46614 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 17:36:11,646 p=46614 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:36:12,011 p=46614 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 17:36:12,011 p=46614 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:36:12,489 p=46614 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 17:36:12,490 p=46614 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:36:13,045 p=46614 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 17:36:13,045 p=46614 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:36:13,074 p=46614 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 17:36:13,075 p=46614 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 17:36:13,075 p=46614 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:36:13,110 p=46614 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 17:36:13,110 p=46614 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:36:13,137 p=46614 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 17:36:13,137 p=46614 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 17:36:13,785 p=46614 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 17:36:13,786 p=46614 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 17:36:13,786 p=46614 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 17:36:13,786 p=46614 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:36:13,820 p=46614 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 17:36:13,820 p=46614 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:36:13,846 p=46614 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 17:36:13,846 p=46614 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:36:13,849 p=46614 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 17:36:14,530 p=46614 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 17:36:14,531 p=46614 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:36:41,039 p=46614 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Remove namespace test-oadp-92] *** 2026-02-05 17:36:41,039 p=46614 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 17:36:41,040 p=46614 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:36:41,040 p=46614 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:36:41,040 p=46614 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:36:41,040 p=46614 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:36:41,447 p=46614 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 17:36:41,447 p=46614 u=1001930000 n=ansible INFO| localhost : ok=16 changed=5 unreachable=0 failed=0 skipped=22 rescued=0 ignored=0 < Exit [DeferCleanup (Each)] Pre exec hook @ 02/05/26 17:36:41.502 (31.68s) > Enter [DeferCleanup (Each)] Pre exec hook @ 02/05/26 17:36:41.502 2026/02/05 17:36:41 Cleaning setup resources for the backup < Exit [DeferCleanup (Each)] Pre exec hook @ 02/05/26 17:36:41.502 (0s) > Enter [DeferCleanup (Each)] Pre exec hook @ 02/05/26 17:36:41.502 2026/02/05 17:36:41 Deleting DPA CR < Exit [DeferCleanup (Each)] Pre exec hook @ 02/05/26 17:36:41.515 (13ms) • [FAILED] [2794.542 seconds] Backup hooks tests Pre exec hook [It] [tc-id:OADP-92][interop][smoke] [Tier0] [vf:backup-hooks] Cassandra app with Restic /alabama/cspi/e2e/hooks/backup_hooks.go:113 [FAILED] Unexpected error: <*fmt.wrapError | 0xc00029c4c0>: operation 'Deploy application ocp-cassandra' failed after 3 attempts: Error during command execution: ansible-playbook error: one or more host failed Command executed: /usr/local/bin/ansible-playbook --extra-vars {"admin_kubeconfig":"/home/jenkins/.kube/config","namespace":"test-oadp-92","non_admin_user":false,"use_role":"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra","user_kubeconfig":"/home/jenkins/.kube/config","with_deploy":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml exit status 2 { msg: "operation 'Deploy application ocp-cassandra' failed after 3 attempts: Error during command execution: ansible-playbook error: one or more host failed\n\nCommand executed: /usr/local/bin/ansible-playbook --extra-vars {\"admin_kubeconfig\":\"/home/jenkins/.kube/config\",\"namespace\":\"test-oadp-92\",\"non_admin_user\":false,\"use_role\":\"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra\",\"user_kubeconfig\":\"/home/jenkins/.kube/config\",\"with_deploy\":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml\n\nexit status 2", err: <*errors.Error | 0xc000a5c000>{ context: "(DefaultExecute::Execute)", message: "Error during command execution: ansible-playbook error: one or more host failed\n\nCommand executed: /usr/local/bin/ansible-playbook --extra-vars {\"admin_kubeconfig\":\"/home/jenkins/.kube/config\",\"namespace\":\"test-oadp-92\",\"non_admin_user\":false,\"use_role\":\"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra\",\"user_kubeconfig\":\"/home/jenkins/.kube/config\",\"with_deploy\":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml\n\nexit status 2", wrappedErrors: nil, }, } occurred In [It] at: /alabama/cspi/test_common/backup_restore_app_case.go:49 @ 02/05/26 17:35:51.692 There were additional failures detected. To view them in detail run ginkgo -vv ------------------------------ SSSSS > Enter [ReportAfterEach] [upstream-velero] Credentials suite @ 02/05/26 17:36:41.515 < Exit [ReportAfterEach] [upstream-velero] Credentials suite @ 02/05/26 17:36:41.515 (0s) SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [datamover] DataMover: Backup/Restore stateful application with CSI  [tc-id:OADP-439][interop] [Tier0] [vf:data-mover] MySQL application /alabama/cspi/e2e/app_backup/backup_restore_datamover.go:34 > Enter [BeforeEach] TOP-LEVEL @ 02/05/26 17:36:41.516 < Exit [BeforeEach] TOP-LEVEL @ 02/05/26 17:36:41.516 (0s) > Enter [BeforeEach] [datamover] DataMover: Backup/Restore stateful application with CSI @ 02/05/26 17:36:41.516 < Exit [BeforeEach] [datamover] DataMover: Backup/Restore stateful application with CSI @ 02/05/26 17:36:41.527 (11ms) > Enter [JustBeforeEach] TOP-LEVEL @ 02/05/26 17:36:41.527 < Exit [JustBeforeEach] TOP-LEVEL @ 02/05/26 17:36:41.527 (0s) > Enter [It] [tc-id:OADP-439][interop] [Tier0] [vf:data-mover] MySQL application @ 02/05/26 17:36:41.527 2026/02/05 17:36:41 Delete all downloadrequest ocp-datavolume-5d53c5a8-02b2-11f1-a828-0a58ac1896e8-68025026-02c5-45ae-8e06-094c58849c38 ocp-datavolume-5d53c5a8-02b2-11f1-a828-0a58ac1896e8-a336d03e-8e37-4f0b-91c1-1c21810ecc1e STEP: Create DPA CR @ 02/05/26 17:36:41.611 2026/02/05 17:36:41 native-datamover 2026/02/05 17:36:41 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "8ba2759a-730a-4564-bf34-f579350e9686", "resourceVersion": "138152", "generation": 1, "creationTimestamp": "2026-02-05T17:36:41Z", "managedFields": [ { "manager": "e2e.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T17:36:41Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:nodeAgent": { ".": {}, "f:enable": {}, "f:podConfig": { ".": {}, "f:resourceAllocations": {} }, "f:uploaderType": {} }, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false }, "nodeAgent": { "enable": true, "podConfig": { "resourceAllocations": {} }, "uploaderType": "kopia" } }, "features": null, "logFormat": "text" }, "status": {} } Delete all the backups that remained in the phase InProgress Deleting backup CRs in progress Deletion of backup CRs in progress completed Delete all the restores that remained in the phase InProgress Deleting restore CRs in progress Deletion of restore CRs in progress completed STEP: Verify DPA CR setup @ 02/05/26 17:36:41.713 2026/02/05 17:36:41 Waiting for velero pod to be running 2026/02/05 17:36:41 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete' 2026/02/05 17:36:41 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "8ba2759a-730a-4564-bf34-f579350e9686", "resourceVersion": "138152", "generation": 1, "creationTimestamp": "2026-02-05T17:36:41Z", "managedFields": [ { "manager": "e2e.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T17:36:41Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:nodeAgent": { ".": {}, "f:enable": {}, "f:podConfig": { ".": {}, "f:resourceAllocations": {} }, "f:uploaderType": {} }, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false }, "nodeAgent": { "enable": true, "podConfig": { "resourceAllocations": {} }, "uploaderType": "kopia" } }, "features": null, "logFormat": "text" }, "status": {} } 2026/02/05 17:36:46 DPA successfully reconciled STEP: Prepare backup resources, depending on the volumes backup type @ 02/05/26 17:36:46.755 Run the command: oc get ns openshift-storage &> /dev/null && echo true || echo false 2026/02/05 17:36:46 The 'openshift-storage' namespace exists 2026/02/05 17:36:46 Checking default storage class count 2026/02/05 17:36:46 Using the CSI driver: openshift-storage.rbd.csi.ceph.com 2026/02/05 17:36:46 Snapclass 'example-snapclass' doesn't exist, creating 2026/02/05 17:36:46 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 17:36:46 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2026/02/05 17:36:46 Checking for correct number of running NodeAgent pods... STEP: Installing application for case mysql @ 02/05/26 17:36:46.979 2026/02/05 17:36:46 🔄 [Attempt 1/3] Executing operation: Deploy application ocp-mysql 2026/02/05 17:36:46 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check namespace test-oadp-439] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Create namespace] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check if SecurityContextConstraints are available] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Set has_scc variable] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Deploy a mysql pod] *** changed: [localhost] FAILED - RETRYING: [localhost]: Check pod status (30 retries left). FAILED - RETRYING: [localhost]: Check pod status (29 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check pod status] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Copy mysql provision script to pod] *** changed: [localhost] FAILED - RETRYING: [localhost]: Wait until service ready for connections (30 retries left). FAILED - RETRYING: [localhost]: Wait until service ready for connections (29 retries left). FAILED - RETRYING: [localhost]: Wait until service ready for connections (28 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Provision the mysql database] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Add dummy data into mysql-data1 pvc] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Create md5 hashes for the files] *** changed: [localhost] Pausing for 30 seconds TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Pause After Create md5 hashes for the files] *** ok: [localhost] PLAY RECAP ********************************************************************* localhost : ok=27  changed=11  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026/02/05 17:37:57 2026-02-05 17:36:48,682 p=46846 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 17:36:48,682 p=46846 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:36:48,989 p=46846 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 17:36:48,989 p=46846 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:36:49,302 p=46846 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 17:36:49,303 p=46846 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:36:49,609 p=46846 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 17:36:49,609 p=46846 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:36:49,627 p=46846 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 17:36:49,627 p=46846 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 17:36:49,627 p=46846 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:36:49,647 p=46846 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 17:36:49,647 p=46846 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:36:49,663 p=46846 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 17:36:49,663 p=46846 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 17:36:50,077 p=46846 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 17:36:50,078 p=46846 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 17:36:50,078 p=46846 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 17:36:50,078 p=46846 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:36:50,104 p=46846 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 17:36:50,104 p=46846 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:36:50,124 p=46846 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 17:36:50,124 p=46846 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:36:50,127 p=46846 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 17:36:50,741 p=46846 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 17:36:50,741 p=46846 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:36:51,874 p=46846 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check namespace test-oadp-439] *** 2026-02-05 17:36:51,874 p=46846 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 17:36:51,875 p=46846 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:36:51,875 p=46846 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:36:51,875 p=46846 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:36:51,875 p=46846 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:36:52,228 p=46846 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Create namespace] *** 2026-02-05 17:36:52,228 p=46846 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:36:53,173 p=46846 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check if SecurityContextConstraints are available] *** 2026-02-05 17:36:53,174 p=46846 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:36:53,204 p=46846 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Set has_scc variable] *** 2026-02-05 17:36:53,204 p=46846 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:36:54,444 p=46846 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Deploy a mysql pod] *** 2026-02-05 17:36:54,445 p=46846 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:36:55,361 p=46846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pod status (30 retries left). 2026-02-05 17:37:01,239 p=46846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pod status (29 retries left). 2026-02-05 17:37:07,161 p=46846 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check pod status] *** 2026-02-05 17:37:07,161 p=46846 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:37:07,685 p=46846 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Copy mysql provision script to pod] *** 2026-02-05 17:37:07,685 p=46846 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:37:08,082 p=46846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until service ready for connections (30 retries left). 2026-02-05 17:37:13,421 p=46846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until service ready for connections (29 retries left). 2026-02-05 17:37:18,803 p=46846 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until service ready for connections (28 retries left). 2026-02-05 17:37:24,153 p=46846 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] *** 2026-02-05 17:37:24,153 p=46846 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:37:26,064 p=46846 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Provision the mysql database] *** 2026-02-05 17:37:26,064 p=46846 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:37:26,900 p=46846 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Add dummy data into mysql-data1 pvc] *** 2026-02-05 17:37:26,901 p=46846 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:37:27,528 p=46846 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Create md5 hashes for the files] *** 2026-02-05 17:37:27,529 p=46846 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:37:27,550 p=46846 u=1001930000 n=ansible INFO| Pausing for 30 seconds 2026-02-05 17:37:57,554 p=46846 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Pause After Create md5 hashes for the files] *** 2026-02-05 17:37:57,554 p=46846 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:37:57,692 p=46846 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 17:37:57,692 p=46846 u=1001930000 n=ansible INFO| localhost : ok=27 changed=11 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 STEP: Verify Application deployment @ 02/05/26 17:37:57.75 2026/02/05 17:37:57 Using admin kubeconfig for with_validate operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check mysql pod status] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Query the inserted data] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Validate test1 file has correct md5 hash] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=19  changed=7  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026/02/05 17:38:04 2026-02-05 17:37:59,510 p=47436 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 17:37:59,511 p=47436 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:37:59,859 p=47436 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 17:37:59,859 p=47436 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:38:00,202 p=47436 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 17:38:00,202 p=47436 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:38:00,527 p=47436 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 17:38:00,527 p=47436 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:38:00,546 p=47436 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 17:38:00,546 p=47436 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 17:38:00,546 p=47436 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:38:00,568 p=47436 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 17:38:00,568 p=47436 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:38:00,584 p=47436 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 17:38:00,584 p=47436 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 17:38:01,073 p=47436 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 17:38:01,073 p=47436 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 17:38:01,073 p=47436 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 17:38:01,073 p=47436 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:38:01,103 p=47436 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 17:38:01,104 p=47436 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:38:01,129 p=47436 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 17:38:01,129 p=47436 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:38:01,132 p=47436 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 17:38:01,797 p=47436 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 17:38:01,798 p=47436 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:38:03,261 p=47436 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check mysql pod status] *** 2026-02-05 17:38:03,262 p=47436 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 17:38:03,262 p=47436 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:38:03,262 p=47436 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:38:03,263 p=47436 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:38:03,263 p=47436 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:38:03,745 p=47436 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] *** 2026-02-05 17:38:03,746 p=47436 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:38:04,256 p=47436 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Query the inserted data] *** 2026-02-05 17:38:04,256 p=47436 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:38:04,900 p=47436 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Validate test1 file has correct md5 hash] *** 2026-02-05 17:38:04,900 p=47436 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:38:04,904 p=47436 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 17:38:04,905 p=47436 u=1001930000 n=ansible INFO| localhost : ok=19 changed=7 unreachable=0 failed=0 skipped=17 rescued=0 ignored=0 2026/02/05 17:38:04 {{ } { } [{{ } {mysql-data test-oadp-439 2f4ed815-f344-47d3-87b6-900c91980f5e 138536 0 2026-02-05 17:36:54 +0000 UTC map[app:mysql testlabel:selectors testlabel2:foo] map[pv.kubernetes.io/bind-completed:yes pv.kubernetes.io/bound-by-controller:yes reclaimspace.csiaddons.openshift.io/cronjob:mysql-data-1770313014 reclaimspace.csiaddons.openshift.io/schedule:@weekly volume.beta.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com volume.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com] [] [kubernetes.io/pvc-protection] [{OpenAPI-Generator Update v1 2026-02-05 17:36:54 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:app":{},"f:testlabel":{},"f:testlabel2":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}} } {csi-addons-manager Update v1 2026-02-05 17:36:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:reclaimspace.csiaddons.openshift.io/cronjob":{},"f:reclaimspace.csiaddons.openshift.io/schedule":{}}}} } {kube-controller-manager Update v1 2026-02-05 17:36:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:pv.kubernetes.io/bind-completed":{},"f:pv.kubernetes.io/bound-by-controller":{},"f:volume.beta.kubernetes.io/storage-provisioner":{},"f:volume.kubernetes.io/storage-provisioner":{}}},"f:spec":{"f:volumeName":{}}} } {kube-controller-manager Update v1 2026-02-05 17:36:54 +0000 UTC FieldsV1 {"f:status":{"f:accessModes":{},"f:capacity":{".":{},"f:storage":{}},"f:phase":{}}} status}]} {[ReadWriteOnce] nil {map[] map[storage:{{2147483648 0} {} 2Gi BinarySI}]} pvc-2f4ed815-f344-47d3-87b6-900c91980f5e 0xc000d01940 0xc000d01950 nil nil } {Bound [ReadWriteOnce] map[storage:{{2147483648 0} {} 2Gi BinarySI}] [] map[] map[] nil}} {{ } {mysql-data1 test-oadp-439 135c88da-2b3d-488a-9fa3-917d75195cf2 138559 0 2026-02-05 17:36:54 +0000 UTC map[app:mysql testlabel:selectors testlabel2:foo] map[pv.kubernetes.io/bind-completed:yes pv.kubernetes.io/bound-by-controller:yes reclaimspace.csiaddons.openshift.io/cronjob:mysql-data1-1770313014 reclaimspace.csiaddons.openshift.io/schedule:@weekly volume.beta.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com volume.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com] [] [kubernetes.io/pvc-protection] [{OpenAPI-Generator Update v1 2026-02-05 17:36:54 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:app":{},"f:testlabel":{},"f:testlabel2":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}} } {csi-addons-manager Update v1 2026-02-05 17:36:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:reclaimspace.csiaddons.openshift.io/cronjob":{},"f:reclaimspace.csiaddons.openshift.io/schedule":{}}}} } {kube-controller-manager Update v1 2026-02-05 17:36:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:pv.kubernetes.io/bind-completed":{},"f:pv.kubernetes.io/bound-by-controller":{},"f:volume.beta.kubernetes.io/storage-provisioner":{},"f:volume.kubernetes.io/storage-provisioner":{}}},"f:spec":{"f:volumeName":{}}} } {kube-controller-manager Update v1 2026-02-05 17:36:54 +0000 UTC FieldsV1 {"f:status":{"f:accessModes":{},"f:capacity":{".":{},"f:storage":{}},"f:phase":{}}} status}]} {[ReadWriteOnce] nil {map[] map[storage:{{2147483648 0} {} 2Gi BinarySI}]} pvc-135c88da-2b3d-488a-9fa3-917d75195cf2 0xc000d01ab0 0xc000d01ac0 nil nil } {Bound [ReadWriteOnce] map[storage:{{2147483648 0} {} 2Gi BinarySI}] [] map[] map[] nil}}]} STEP: Creating backup mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8 @ 02/05/26 17:38:04.967 2026/02/05 17:38:04 Wait until backup mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8 is completed backup phase: WaitingForPluginOperations backup phase: Completed 2026/02/05 17:38:45 Validating 2 DataUploads for backup mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8 2026/02/05 17:38:45 DataUpload mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-9g2v5 has phase: Completed 2026/02/05 17:38:45 apiVersion: velero.io/v2alpha1 kind: DataUpload metadata: creationTimestamp: "2026-02-05T17:38:11Z" generateName: mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8- generation: 7 labels: velero.io/async-operation-id: du-e88aad73-eed2-4908-bb51-ac009b126468.2f4ed815-f344-47d4c94d4 velero.io/backup-name: mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8 velero.io/backup-uid: e88aad73-eed2-4908-bb51-ac009b126468 velero.io/pvc-uid: 2f4ed815-f344-47d3-87b6-900c91980f5e managedFields: - apiVersion: velero.io/v2alpha1 fieldsType: FieldsV1 fieldsV1: f:metadata: f:generateName: {} f:labels: .: {} f:velero.io/async-operation-id: {} f:velero.io/backup-name: {} f:velero.io/backup-uid: {} f:velero.io/pvc-uid: {} f:ownerReferences: .: {} k:{"uid":"e88aad73-eed2-4908-bb51-ac009b126468"}: {} f:spec: .: {} f:backupStorageLocation: {} f:csiSnapshot: .: {} f:snapshotClass: {} f:storageClass: {} f:volumeSnapshot: {} f:operationTimeout: {} f:snapshotType: {} f:sourceNamespace: {} f:sourcePVC: {} f:status: .: {} f:progress: {} manager: velero operation: Update time: "2026-02-05T17:38:11Z" - apiVersion: velero.io/v2alpha1 fieldsType: FieldsV1 fieldsV1: f:status: f:acceptedByNode: {} f:acceptedTimestamp: {} f:completionTimestamp: {} f:node: {} f:nodeOS: {} f:path: {} f:phase: {} f:progress: f:bytesDone: {} f:totalBytes: {} f:snapshotID: {} f:startTimestamp: {} manager: node-agent-server operation: Update time: "2026-02-05T17:38:31Z" name: mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-9g2v5 namespace: openshift-adp ownerReferences: - apiVersion: velero.io/v1 controller: true kind: Backup name: mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8 uid: e88aad73-eed2-4908-bb51-ac009b126468 resourceVersion: "140136" uid: 0cc67be3-35a2-40ee-a850-af7f0ba0325d spec: backupStorageLocation: ts-dpa-1 csiSnapshot: snapshotClass: example-snapclass storageClass: odf-operator-ceph-rbd volumeSnapshot: velero-mysql-data-mv86h operationTimeout: 10m0s snapshotType: CSI sourceNamespace: test-oadp-439 sourcePVC: mysql-data status: acceptedByNode: ip-10-0-98-206.us-east-2.compute.internal acceptedTimestamp: "2026-02-05T17:38:11Z" completionTimestamp: "2026-02-05T17:38:31Z" node: ip-10-0-98-206.us-east-2.compute.internal nodeOS: linux path: /0cc67be3-35a2-40ee-a850-af7f0ba0325d phase: Completed progress: bytesDone: 107854713 totalBytes: 107854713 snapshotID: 5de3c6fdfba9dc2b6477ee2017e5a6e6 startTimestamp: "2026-02-05T17:38:22Z" 2026/02/05 17:38:45 DataUpload mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-9g2v5 completed successfully 2026/02/05 17:38:45 DataUpload mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-rrt5w has phase: Completed 2026/02/05 17:38:45 apiVersion: velero.io/v2alpha1 kind: DataUpload metadata: creationTimestamp: "2026-02-05T17:38:17Z" generateName: mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8- generation: 7 labels: velero.io/async-operation-id: du-e88aad73-eed2-4908-bb51-ac009b126468.135c88da-2b3d-488df5ca4 velero.io/backup-name: mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8 velero.io/backup-uid: e88aad73-eed2-4908-bb51-ac009b126468 velero.io/pvc-uid: 135c88da-2b3d-488a-9fa3-917d75195cf2 managedFields: - apiVersion: velero.io/v2alpha1 fieldsType: FieldsV1 fieldsV1: f:metadata: f:generateName: {} f:labels: .: {} f:velero.io/async-operation-id: {} f:velero.io/backup-name: {} f:velero.io/backup-uid: {} f:velero.io/pvc-uid: {} f:ownerReferences: .: {} k:{"uid":"e88aad73-eed2-4908-bb51-ac009b126468"}: {} f:spec: .: {} f:backupStorageLocation: {} f:csiSnapshot: .: {} f:snapshotClass: {} f:storageClass: {} f:volumeSnapshot: {} f:operationTimeout: {} f:snapshotType: {} f:sourceNamespace: {} f:sourcePVC: {} f:status: .: {} f:progress: {} manager: velero operation: Update time: "2026-02-05T17:38:17Z" - apiVersion: velero.io/v2alpha1 fieldsType: FieldsV1 fieldsV1: f:status: f:acceptedByNode: {} f:acceptedTimestamp: {} f:completionTimestamp: {} f:node: {} f:nodeOS: {} f:path: {} f:phase: {} f:progress: f:bytesDone: {} f:totalBytes: {} f:snapshotID: {} f:startTimestamp: {} manager: node-agent-server operation: Update time: "2026-02-05T17:38:33Z" name: mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-rrt5w namespace: openshift-adp ownerReferences: - apiVersion: velero.io/v1 controller: true kind: Backup name: mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8 uid: e88aad73-eed2-4908-bb51-ac009b126468 resourceVersion: "140183" uid: 346293fe-b85b-4b7a-930a-fb38507f55ae spec: backupStorageLocation: ts-dpa-1 csiSnapshot: snapshotClass: example-snapclass storageClass: odf-operator-ceph-rbd volumeSnapshot: velero-mysql-data1-6wmp6 operationTimeout: 10m0s snapshotType: CSI sourceNamespace: test-oadp-439 sourcePVC: mysql-data1 status: acceptedByNode: ip-10-0-7-38.us-east-2.compute.internal acceptedTimestamp: "2026-02-05T17:38:17Z" completionTimestamp: "2026-02-05T17:38:33Z" node: ip-10-0-7-38.us-east-2.compute.internal nodeOS: linux path: /346293fe-b85b-4b7a-930a-fb38507f55ae phase: Completed progress: bytesDone: 104857640 totalBytes: 104857640 snapshotID: 28881c3302a88919049f2487c424bc1c startTimestamp: "2026-02-05T17:38:24Z" 2026/02/05 17:38:45 DataUpload mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-rrt5w completed successfully 2026/02/05 17:38:45 All 2 DataUploads completed successfully for backup mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8 STEP: Verify backup mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8 has completed successfully @ 02/05/26 17:38:45.021 2026/02/05 17:38:45 Backup for case mysql succeeded STEP: Delete the appplication resources mysql @ 02/05/26 17:38:45.067 STEP: Cleanup Application for case mysql @ 02/05/26 17:38:45.067 2026/02/05 17:38:45 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Remove namespace test-oadp-439] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=16  changed=5  unreachable=0 failed=0 skipped=20  rescued=0 ignored=0 2026/02/05 17:39:15 2026-02-05 17:38:46,882 p=47761 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 17:38:46,882 p=47761 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:38:47,197 p=47761 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 17:38:47,197 p=47761 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:38:47,510 p=47761 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 17:38:47,510 p=47761 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:38:47,834 p=47761 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 17:38:47,834 p=47761 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:38:47,852 p=47761 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 17:38:47,852 p=47761 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 17:38:47,852 p=47761 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:38:47,872 p=47761 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 17:38:47,872 p=47761 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:38:47,888 p=47761 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 17:38:47,889 p=47761 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 17:38:48,312 p=47761 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 17:38:48,313 p=47761 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 17:38:48,313 p=47761 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 17:38:48,313 p=47761 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:38:48,341 p=47761 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 17:38:48,341 p=47761 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:38:48,362 p=47761 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 17:38:48,363 p=47761 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:38:48,365 p=47761 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 17:38:48,979 p=47761 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 17:38:48,979 p=47761 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:39:15,220 p=47761 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Remove namespace test-oadp-439] *** 2026-02-05 17:39:15,221 p=47761 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 17:39:15,221 p=47761 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:39:15,222 p=47761 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:39:15,222 p=47761 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:39:15,222 p=47761 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:39:15,613 p=47761 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 17:39:15,613 p=47761 u=1001930000 n=ansible INFO| localhost : ok=16 changed=5 unreachable=0 failed=0 skipped=20 rescued=0 ignored=0 2026/02/05 17:39:15 Creating restore mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8 for case mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8 STEP: Create restore mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8 from backup mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8 @ 02/05/26 17:39:15.681 2026/02/05 17:39:15 Wait until restore mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8 is complete restore phase: WaitingForPluginOperations restore phase: WaitingForPluginOperations restore phase: WaitingForPluginOperations restore phase: Finalizing restore phase: Completed 2026/02/05 17:40:05 Validating 2 DataDownloads for restore mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8 2026/02/05 17:40:05 DataDownload mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-krpxl has phase: Completed 2026/02/05 17:40:05 apiVersion: velero.io/v2alpha1 kind: DataDownload metadata: creationTimestamp: "2026-02-05T17:39:17Z" generateName: mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8- generation: 6 labels: velero.io/async-operation-id: dd-f642de4f-b5fe-407c-91e0-4381d628f067.2f4ed815-f344-47d3d9c51 velero.io/restore-name: mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8 velero.io/restore-uid: f642de4f-b5fe-407c-91e0-4381d628f067 managedFields: - apiVersion: velero.io/v2alpha1 fieldsType: FieldsV1 fieldsV1: f:metadata: f:generateName: {} f:labels: .: {} f:velero.io/async-operation-id: {} f:velero.io/restore-name: {} f:velero.io/restore-uid: {} f:ownerReferences: .: {} k:{"uid":"f642de4f-b5fe-407c-91e0-4381d628f067"}: {} f:spec: .: {} f:backupStorageLocation: {} f:nodeOS: {} f:operationTimeout: {} f:snapshotID: {} f:sourceNamespace: {} f:targetVolume: .: {} f:namespace: {} f:pv: {} f:pvc: {} f:status: .: {} f:progress: {} manager: velero operation: Update time: "2026-02-05T17:39:17Z" - apiVersion: velero.io/v2alpha1 fieldsType: FieldsV1 fieldsV1: f:status: f:acceptedByNode: {} f:acceptedTimestamp: {} f:completionTimestamp: {} f:node: {} f:phase: {} f:progress: f:bytesDone: {} f:totalBytes: {} f:startTimestamp: {} manager: node-agent-server operation: Update time: "2026-02-05T17:39:40Z" name: mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-krpxl namespace: openshift-adp ownerReferences: - apiVersion: velero.io/v1 controller: true kind: Restore name: mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8 uid: f642de4f-b5fe-407c-91e0-4381d628f067 resourceVersion: "141436" uid: 4207f638-ad76-42cb-bce7-888f4c3116c3 spec: backupStorageLocation: ts-dpa-1 nodeOS: linux operationTimeout: 10m0s snapshotID: 5de3c6fdfba9dc2b6477ee2017e5a6e6 sourceNamespace: test-oadp-439 targetVolume: namespace: test-oadp-439 pv: "" pvc: mysql-data status: acceptedByNode: ip-10-0-7-38.us-east-2.compute.internal acceptedTimestamp: "2026-02-05T17:39:17Z" completionTimestamp: "2026-02-05T17:39:40Z" node: ip-10-0-98-206.us-east-2.compute.internal phase: Completed progress: bytesDone: 107854713 totalBytes: 107854713 startTimestamp: "2026-02-05T17:39:22Z" 2026/02/05 17:40:05 DataDownload mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-krpxl completed successfully 2026/02/05 17:40:05 DataDownload mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-wg77z has phase: Completed 2026/02/05 17:40:05 apiVersion: velero.io/v2alpha1 kind: DataDownload metadata: creationTimestamp: "2026-02-05T17:39:17Z" generateName: mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8- generation: 6 labels: velero.io/async-operation-id: dd-f642de4f-b5fe-407c-91e0-4381d628f067.135c88da-2b3d-4881fb511 velero.io/restore-name: mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8 velero.io/restore-uid: f642de4f-b5fe-407c-91e0-4381d628f067 managedFields: - apiVersion: velero.io/v2alpha1 fieldsType: FieldsV1 fieldsV1: f:metadata: f:generateName: {} f:labels: .: {} f:velero.io/async-operation-id: {} f:velero.io/restore-name: {} f:velero.io/restore-uid: {} f:ownerReferences: .: {} k:{"uid":"f642de4f-b5fe-407c-91e0-4381d628f067"}: {} f:spec: .: {} f:backupStorageLocation: {} f:nodeOS: {} f:operationTimeout: {} f:snapshotID: {} f:sourceNamespace: {} f:targetVolume: .: {} f:namespace: {} f:pv: {} f:pvc: {} f:status: .: {} f:progress: {} manager: velero operation: Update time: "2026-02-05T17:39:17Z" - apiVersion: velero.io/v2alpha1 fieldsType: FieldsV1 fieldsV1: f:status: f:acceptedByNode: {} f:acceptedTimestamp: {} f:completionTimestamp: {} f:node: {} f:phase: {} f:progress: f:bytesDone: {} f:totalBytes: {} f:startTimestamp: {} manager: node-agent-server operation: Update time: "2026-02-05T17:39:39Z" name: mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-wg77z namespace: openshift-adp ownerReferences: - apiVersion: velero.io/v1 controller: true kind: Restore name: mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8 uid: f642de4f-b5fe-407c-91e0-4381d628f067 resourceVersion: "141422" uid: a65df8cf-bc32-451e-9c69-447bd0b2b514 spec: backupStorageLocation: ts-dpa-1 nodeOS: linux operationTimeout: 10m0s snapshotID: 28881c3302a88919049f2487c424bc1c sourceNamespace: test-oadp-439 targetVolume: namespace: test-oadp-439 pv: "" pvc: mysql-data1 status: acceptedByNode: ip-10-0-60-83.us-east-2.compute.internal acceptedTimestamp: "2026-02-05T17:39:17Z" completionTimestamp: "2026-02-05T17:39:39Z" node: ip-10-0-7-38.us-east-2.compute.internal phase: Completed progress: bytesDone: 104857640 totalBytes: 104857640 startTimestamp: "2026-02-05T17:39:25Z" 2026/02/05 17:40:05 DataDownload mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-wg77z completed successfully 2026/02/05 17:40:05 All 2 DataDownloads completed successfully for restore mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8 STEP: Verify restore mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8has completed successfully @ 02/05/26 17:40:05.762 STEP: Verify Application restore @ 02/05/26 17:40:05.764 STEP: Verify Application deployment for case mysql @ 02/05/26 17:40:05.765 2026/02/05 17:40:05 Using admin kubeconfig for with_validate operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check mysql pod status] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Query the inserted data] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Validate test1 file has correct md5 hash] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=19  changed=7  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026/02/05 17:40:13 2026-02-05 17:40:07,588 p=47991 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 17:40:07,588 p=47991 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:40:08,031 p=47991 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 17:40:08,031 p=47991 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:40:08,457 p=47991 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 17:40:08,457 p=47991 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:40:08,908 p=47991 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 17:40:08,908 p=47991 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:40:08,933 p=47991 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 17:40:08,934 p=47991 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 17:40:08,934 p=47991 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:40:08,960 p=47991 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 17:40:08,961 p=47991 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:40:08,985 p=47991 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 17:40:08,986 p=47991 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 17:40:09,524 p=47991 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 17:40:09,525 p=47991 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 17:40:09,525 p=47991 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 17:40:09,526 p=47991 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:40:09,555 p=47991 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 17:40:09,556 p=47991 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:40:09,577 p=47991 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 17:40:09,577 p=47991 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:40:09,580 p=47991 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 17:40:10,201 p=47991 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 17:40:10,201 p=47991 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:40:11,604 p=47991 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check mysql pod status] *** 2026-02-05 17:40:11,605 p=47991 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 17:40:11,605 p=47991 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:40:11,605 p=47991 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:40:11,606 p=47991 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:40:11,606 p=47991 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:40:12,082 p=47991 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] *** 2026-02-05 17:40:12,083 p=47991 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:40:12,598 p=47991 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Query the inserted data] *** 2026-02-05 17:40:12,598 p=47991 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:40:13,294 p=47991 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Validate test1 file has correct md5 hash] *** 2026-02-05 17:40:13,294 p=47991 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:40:13,299 p=47991 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 17:40:13,299 p=47991 u=1001930000 n=ansible INFO| localhost : ok=19 changed=7 unreachable=0 failed=0 skipped=17 rescued=0 ignored=0 < Exit [It] [tc-id:OADP-439][interop] [Tier0] [vf:data-mover] MySQL application @ 02/05/26 17:40:13.366 (3m31.839s) > Enter [JustAfterEach] TOP-LEVEL @ 02/05/26 17:40:13.367 2026/02/05 17:40:13 Using Must-gather image: registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 Secret deletion flag: true Deleting cloud credentials secret cloud-credentials in namespace openshift-adp < Exit [JustAfterEach] TOP-LEVEL @ 02/05/26 17:40:13.375 (9ms) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 17:40:13.375 < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 17:40:13.38 (5ms) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 17:40:13.38 < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 17:40:13.38 (0s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 17:40:13.38 2026/02/05 17:40:13 Cleaning app 2026/02/05 17:40:13 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Remove namespace test-oadp-439] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=16  changed=5  unreachable=0 failed=0 skipped=20  rescued=0 ignored=0 2026/02/05 17:40:43 2026-02-05 17:40:15,135 p=48293 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 17:40:15,135 p=48293 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:40:15,463 p=48293 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 17:40:15,463 p=48293 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:40:15,793 p=48293 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 17:40:15,793 p=48293 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:40:16,114 p=48293 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 17:40:16,114 p=48293 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:40:16,132 p=48293 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 17:40:16,132 p=48293 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 17:40:16,132 p=48293 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:40:16,152 p=48293 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 17:40:16,152 p=48293 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:40:16,166 p=48293 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 17:40:16,167 p=48293 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 17:40:16,602 p=48293 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 17:40:16,602 p=48293 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 17:40:16,602 p=48293 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 17:40:16,603 p=48293 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:40:16,631 p=48293 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 17:40:16,631 p=48293 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:40:16,652 p=48293 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 17:40:16,652 p=48293 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:40:16,655 p=48293 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 17:40:17,272 p=48293 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 17:40:17,272 p=48293 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:40:43,456 p=48293 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Remove namespace test-oadp-439] *** 2026-02-05 17:40:43,457 p=48293 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 17:40:43,457 p=48293 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:40:43,457 p=48293 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:40:43,458 p=48293 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:40:43,458 p=48293 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:40:43,822 p=48293 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 17:40:43,822 p=48293 u=1001930000 n=ansible INFO| localhost : ok=16 changed=5 unreachable=0 failed=0 skipped=20 rescued=0 ignored=0 < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 17:40:43.884 (30.504s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 17:40:43.884 2026/02/05 17:40:43 Cleaning setup resources for the backup 2026/02/05 17:40:43 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 17:40:43 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2026/02/05 17:40:43 Deleting VolumeSnapshotClass 'example-snapclass' < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 17:40:43.901 (17ms) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 17:40:43.901 2026/02/05 17:40:43 Deleting DPA CR < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 17:40:43.909 (8ms) • [242.393 seconds] ------------------------------ [datamover] DataMover: Backup/Restore stateful application with CSI  [tc-id:OADP-440][interop] [Tier0] [vf:data-mover] Cassandra application /alabama/cspi/e2e/app_backup/backup_restore_datamover.go:50 > Enter [BeforeEach] TOP-LEVEL @ 02/05/26 17:40:43.909 < Exit [BeforeEach] TOP-LEVEL @ 02/05/26 17:40:43.909 (0s) > Enter [BeforeEach] [datamover] DataMover: Backup/Restore stateful application with CSI @ 02/05/26 17:40:43.909 < Exit [BeforeEach] [datamover] DataMover: Backup/Restore stateful application with CSI @ 02/05/26 17:40:43.914 (5ms) > Enter [JustBeforeEach] TOP-LEVEL @ 02/05/26 17:40:43.914 < Exit [JustBeforeEach] TOP-LEVEL @ 02/05/26 17:40:43.914 (0s) > Enter [It] [tc-id:OADP-440][interop] [Tier0] [vf:data-mover] Cassandra application @ 02/05/26 17:40:43.914 2026/02/05 17:40:43 Delete all downloadrequest No download requests are found STEP: Create DPA CR @ 02/05/26 17:40:43.927 2026/02/05 17:40:43 native-datamover 2026/02/05 17:40:43 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "a87b01da-4479-4f22-a264-25499fae7b45", "resourceVersion": "142524", "generation": 1, "creationTimestamp": "2026-02-05T17:40:43Z", "managedFields": [ { "manager": "e2e.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T17:40:43Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:nodeAgent": { ".": {}, "f:enable": {}, "f:podConfig": { ".": {}, "f:resourceAllocations": {} }, "f:uploaderType": {} }, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false }, "nodeAgent": { "enable": true, "podConfig": { "resourceAllocations": {} }, "uploaderType": "kopia" } }, "features": null, "logFormat": "text" }, "status": {} } Delete all the backups that remained in the phase InProgress Deleting backup CRs in progress Deletion of backup CRs in progress completed Delete all the restores that remained in the phase InProgress Deleting restore CRs in progress Deletion of restore CRs in progress completed STEP: Verify DPA CR setup @ 02/05/26 17:40:44.029 2026/02/05 17:40:44 Waiting for velero pod to be running 2026/02/05 17:40:44 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete' 2026/02/05 17:40:44 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "a87b01da-4479-4f22-a264-25499fae7b45", "resourceVersion": "142524", "generation": 1, "creationTimestamp": "2026-02-05T17:40:43Z", "managedFields": [ { "manager": "e2e.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T17:40:43Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:nodeAgent": { ".": {}, "f:enable": {}, "f:podConfig": { ".": {}, "f:resourceAllocations": {} }, "f:uploaderType": {} }, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false }, "nodeAgent": { "enable": true, "podConfig": { "resourceAllocations": {} }, "uploaderType": "kopia" } }, "features": null, "logFormat": "text" }, "status": {} } 2026/02/05 17:40:49 DPA successfully reconciled STEP: Prepare backup resources, depending on the volumes backup type @ 02/05/26 17:40:49.054 Run the command: oc get ns openshift-storage &> /dev/null && echo true || echo false 2026/02/05 17:40:49 The 'openshift-storage' namespace exists 2026/02/05 17:40:49 Checking default storage class count 2026/02/05 17:40:49 Using the CSI driver: openshift-storage.rbd.csi.ceph.com 2026/02/05 17:40:49 Snapclass 'example-snapclass' doesn't exist, creating 2026/02/05 17:40:49 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 17:40:49 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2026/02/05 17:40:49 Checking for correct number of running NodeAgent pods... STEP: Installing application for case cassandra-e2e @ 02/05/26 17:40:49.385 2026/02/05 17:40:49 🔄 [Attempt 1/3] Executing operation: Deploy application ocp-cassandra 2026/02/05 17:40:49 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create namespace] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** changed: [localhost] [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** changed: [localhost] FAILED - RETRYING: [localhost]: Check pods status (30 retries left). FAILED - RETRYING: [localhost]: Check pods status (29 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** ok: [localhost] FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3  50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal)  ^ column 3  fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-440 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.175511", "end": "2026-02-05 17:44:04.521081", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 17:44:04.345570", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} PLAY RECAP ********************************************************************* localhost : ok=21  changed=8  unreachable=0 failed=1  skipped=2  rescued=0 ignored=0 2026/02/05 17:44:04 2026-02-05 17:40:51,127 p=48541 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 17:40:51,128 p=48541 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:40:51,476 p=48541 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 17:40:51,476 p=48541 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:40:51,814 p=48541 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 17:40:51,814 p=48541 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:40:52,136 p=48541 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 17:40:52,137 p=48541 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:40:52,155 p=48541 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 17:40:52,155 p=48541 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 17:40:52,155 p=48541 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:40:52,175 p=48541 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 17:40:52,175 p=48541 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:40:52,189 p=48541 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 17:40:52,190 p=48541 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 17:40:52,625 p=48541 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 17:40:52,625 p=48541 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 17:40:52,626 p=48541 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 17:40:52,626 p=48541 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:40:52,655 p=48541 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 17:40:52,655 p=48541 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:40:52,677 p=48541 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 17:40:52,677 p=48541 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:40:52,680 p=48541 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 17:40:53,317 p=48541 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 17:40:53,317 p=48541 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:40:54,441 p=48541 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** 2026-02-05 17:40:54,441 p=48541 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 17:40:54,442 p=48541 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:40:54,442 p=48541 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:40:54,442 p=48541 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:40:54,442 p=48541 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:40:54,993 p=48541 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create namespace] *** 2026-02-05 17:40:54,994 p=48541 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:40:55,343 p=48541 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** 2026-02-05 17:40:55,343 p=48541 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:40:56,548 p=48541 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** 2026-02-05 17:40:56,549 p=48541 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:40:57,585 p=48541 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** 2026-02-05 17:40:57,586 p=48541 u=1001930000 n=ansible WARNING| [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" 2026-02-05 17:40:57,586 p=48541 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. 2026-02-05 17:40:57,586 p=48541 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:40:58,543 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (30 retries left). 2026-02-05 17:41:04,455 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (29 retries left). 2026-02-05 17:41:10,389 p=48541 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** 2026-02-05 17:41:10,390 p=48541 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:41:11,231 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). 2026-02-05 17:41:18,230 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). 2026-02-05 17:41:23,665 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). 2026-02-05 17:41:29,064 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). 2026-02-05 17:41:38,430 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). 2026-02-05 17:41:43,838 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). 2026-02-05 17:41:49,260 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). 2026-02-05 17:41:54,646 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). 2026-02-05 17:42:00,046 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). 2026-02-05 17:42:05,445 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). 2026-02-05 17:42:12,829 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). 2026-02-05 17:42:18,278 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). 2026-02-05 17:42:23,685 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). 2026-02-05 17:42:29,093 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). 2026-02-05 17:42:34,474 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). 2026-02-05 17:42:39,889 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). 2026-02-05 17:42:45,289 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). 2026-02-05 17:42:50,715 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). 2026-02-05 17:42:56,113 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). 2026-02-05 17:43:01,530 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). 2026-02-05 17:43:10,329 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). 2026-02-05 17:43:15,745 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). 2026-02-05 17:43:21,168 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). 2026-02-05 17:43:26,604 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). 2026-02-05 17:43:32,018 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). 2026-02-05 17:43:37,458 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). 2026-02-05 17:43:42,878 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). 2026-02-05 17:43:48,308 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). 2026-02-05 17:43:53,718 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). 2026-02-05 17:43:59,145 p=48541 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). 2026-02-05 17:44:04,550 p=48541 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** 2026-02-05 17:44:04,551 p=48541 u=1001930000 n=ansible ERROR| [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3 50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal) ^ column 3 2026-02-05 17:44:04,551 p=48541 u=1001930000 n=ansible INFO| fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-440 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.175511", "end": "2026-02-05 17:44:04.521081", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 17:44:04.345570", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} 2026-02-05 17:44:04,553 p=48541 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 17:44:04,553 p=48541 u=1001930000 n=ansible INFO| localhost : ok=21 changed=8 unreachable=0 failed=1 skipped=2 rescued=0 ignored=0 Run the command: oc get event -n test-oadp-440 2026/02/05 17:44:04 LAST SEEN TYPE REASON OBJECT MESSAGE 3m7s Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 3m6s Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 3m6s Normal Scheduled pod/cassandra-0 Successfully assigned test-oadp-440/cassandra-0 to ip-10-0-60-83.us-east-2.compute.internal 3m6s Normal SuccessfulAttachVolume pod/cassandra-0 AttachVolume.Attach succeeded for volume "pvc-b1dec212-da28-4a61-a0e3-5e8a586d62b0" 3m1s Normal AddedInterface pod/cassandra-0 Add eth0 [10.129.2.197/23] from ovn-kubernetes 61s Normal Pulling pod/cassandra-0 Pulling image "quay.io/migqe/cassandra:multiarch" 3m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 805ms (805ms including waiting). Image size: 307783610 bytes. 60s Normal Created pod/cassandra-0 Created container: cassandra 60s Normal Started pod/cassandra-0 Started container cassandra 2m52s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 535ms (535ms including waiting). Image size: 307783610 bytes. 2s Warning BackOff pod/cassandra-0 Back-off restarting failed container cassandra in pod cassandra-0_test-oadp-440(d2d0ef44-620e-4d38-9652-e873d770d93b) 2m32s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 505ms (505ms including waiting). Image size: 307783610 bytes. 117s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 717ms (717ms including waiting). Image size: 307783610 bytes. 60s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 955ms (955ms including waiting). Image size: 307783610 bytes. 3m Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 2m59s Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 2m59s Normal Scheduled pod/cassandra-1 Successfully assigned test-oadp-440/cassandra-1 to ip-10-0-98-206.us-east-2.compute.internal 2m59s Normal SuccessfulAttachVolume pod/cassandra-1 AttachVolume.Attach succeeded for volume "pvc-ad1953af-1f28-415c-a7cf-4cdd1aae19ad" 2m50s Normal AddedInterface pod/cassandra-1 Add eth0 [10.131.0.90/23] from ovn-kubernetes 55s Normal Pulling pod/cassandra-1 Pulling image "quay.io/migqe/cassandra:multiarch" 2m50s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 483ms (483ms including waiting). Image size: 307783610 bytes. 54s Normal Created pod/cassandra-1 Created container: cassandra 54s Normal Started pod/cassandra-1 Started container cassandra 2m44s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 478ms (478ms including waiting). Image size: 307783610 bytes. 4s Warning BackOff pod/cassandra-1 Back-off restarting failed container cassandra in pod cassandra-1_test-oadp-440(23df954f-e68d-454e-8910-6e5968124d6e) 2m29s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 386ms (386ms including waiting). Image size: 307783610 bytes. 117s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 639ms (639ms including waiting). Image size: 307783610 bytes. 54s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 556ms (556ms including waiting). Image size: 307783610 bytes. 2m48s Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 2m48s Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 2m48s Normal Scheduled pod/cassandra-2 Successfully assigned test-oadp-440/cassandra-2 to ip-10-0-7-38.us-east-2.compute.internal 2m48s Normal SuccessfulAttachVolume pod/cassandra-2 AttachVolume.Attach succeeded for volume "pvc-695f3daa-09a5-4081-a5f7-a2f88f777011" 2m47s Normal AddedInterface pod/cassandra-2 Add eth0 [10.128.2.57/23] from ovn-kubernetes 60s Normal Pulling pod/cassandra-2 Pulling image "quay.io/migqe/cassandra:multiarch" 2m46s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 523ms (523ms including waiting). Image size: 307783610 bytes. 60s Normal Created pod/cassandra-2 Created container: cassandra 60s Normal Started pod/cassandra-2 Started container cassandra 2m41s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 397ms (397ms including waiting). Image size: 307783610 bytes. 0s Warning BackOff pod/cassandra-2 Back-off restarting failed container cassandra in pod cassandra-2_test-oadp-440(fb543948-b0ac-4143-81d7-e708be1e27db) 2m21s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 566ms (566ms including waiting). Image size: 307783610 bytes. 110s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 813ms (813ms including waiting). Image size: 307783610 bytes. 60s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 519ms (519ms including waiting). Image size: 307783610 bytes. 3m7s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-0 External provisioner is provisioning volume for claim "test-oadp-440/cassandra-data-cassandra-0" 3m7s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-0 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 3m7s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-0 Successfully provisioned volume pvc-b1dec212-da28-4a61-a0e3-5e8a586d62b0 3m Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-1 External provisioner is provisioning volume for claim "test-oadp-440/cassandra-data-cassandra-1" 3m Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-1 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 3m Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-1 Successfully provisioned volume pvc-ad1953af-1f28-415c-a7cf-4cdd1aae19ad 2m49s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-2 External provisioner is provisioning volume for claim "test-oadp-440/cassandra-data-cassandra-2" 2m49s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-2 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 2m48s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-2 Successfully provisioned volume pvc-695f3daa-09a5-4081-a5f7-a2f88f777011 3m7s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-0 Pod cassandra-0 in StatefulSet cassandra success 3m7s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-0 in StatefulSet cassandra successful 3m Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-1 Pod cassandra-1 in StatefulSet cassandra success 3m Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-1 in StatefulSet cassandra successful 2m49s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-2 Pod cassandra-2 in StatefulSet cassandra success 2m49s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-2 in StatefulSet cassandra successful 2026/02/05 17:44:04 Found server error pattern in ansible logs: '502' 2026/02/05 17:44:04 Detected server errors in ansible logs - treating as retryable 2026/02/05 17:44:04 ⚠️ Operation 'Deploy application ocp-cassandra' failed with retryable server error (attempt 1/3): Error during command execution: ansible-playbook error: one or more host failed Command executed: /usr/local/bin/ansible-playbook --extra-vars {"admin_kubeconfig":"/home/jenkins/.kube/config","namespace":"test-oadp-440","non_admin_user":false,"use_role":"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra","user_kubeconfig":"/home/jenkins/.kube/config","with_deploy":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml exit status 2 2026/02/05 17:44:04 🕐 Waiting 1m0s before retry... 2026/02/05 17:45:04 🔄 [Attempt 2/3] Executing operation: Deploy application ocp-cassandra 2026/02/05 17:45:04 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** ok: [localhost] [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** ok: [localhost] FAILED - RETRYING: [localhost]: Check pods status (30 retries left). FAILED - RETRYING: [localhost]: Check pods status (29 retries left). FAILED - RETRYING: [localhost]: Check pods status (28 retries left). FAILED - RETRYING: [localhost]: Check pods status (27 retries left). FAILED - RETRYING: [localhost]: Check pods status (26 retries left). FAILED - RETRYING: [localhost]: Check pods status (25 retries left). FAILED - RETRYING: [localhost]: Check pods status (24 retries left). FAILED - RETRYING: [localhost]: Check pods status (23 retries left). FAILED - RETRYING: [localhost]: Check pods status (22 retries left). FAILED - RETRYING: [localhost]: Check pods status (21 retries left). FAILED - RETRYING: [localhost]: Check pods status (20 retries left). FAILED - RETRYING: [localhost]: Check pods status (19 retries left). FAILED - RETRYING: [localhost]: Check pods status (18 retries left). FAILED - RETRYING: [localhost]: Check pods status (17 retries left). FAILED - RETRYING: [localhost]: Check pods status (16 retries left). FAILED - RETRYING: [localhost]: Check pods status (15 retries left). FAILED - RETRYING: [localhost]: Check pods status (14 retries left). FAILED - RETRYING: [localhost]: Check pods status (13 retries left). FAILED - RETRYING: [localhost]: Check pods status (12 retries left). FAILED - RETRYING: [localhost]: Check pods status (11 retries left). FAILED - RETRYING: [localhost]: Check pods status (10 retries left). FAILED - RETRYING: [localhost]: Check pods status (9 retries left). FAILED - RETRYING: [localhost]: Check pods status (8 retries left). FAILED - RETRYING: [localhost]: Check pods status (7 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** ok: [localhost] FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3  50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal)  ^ column 3  fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-440 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.186164", "end": "2026-02-05 17:50:23.840791", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 17:50:23.654627", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} PLAY RECAP ********************************************************************* localhost : ok=20  changed=5  unreachable=0 failed=1  skipped=3  rescued=0 ignored=0 2026/02/05 17:50:23 2026-02-05 17:45:06,497 p=49912 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 17:45:06,498 p=49912 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:45:06,834 p=49912 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 17:45:06,834 p=49912 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:45:07,153 p=49912 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 17:45:07,153 p=49912 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:45:07,469 p=49912 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 17:45:07,469 p=49912 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:45:07,486 p=49912 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 17:45:07,487 p=49912 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 17:45:07,487 p=49912 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:45:07,506 p=49912 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 17:45:07,506 p=49912 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:45:07,521 p=49912 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 17:45:07,521 p=49912 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 17:45:07,959 p=49912 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 17:45:07,960 p=49912 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 17:45:07,960 p=49912 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 17:45:07,960 p=49912 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:45:07,991 p=49912 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 17:45:07,992 p=49912 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:45:08,015 p=49912 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 17:45:08,015 p=49912 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:45:08,018 p=49912 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 17:45:08,623 p=49912 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 17:45:08,623 p=49912 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:45:09,754 p=49912 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** 2026-02-05 17:45:09,755 p=49912 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 17:45:09,755 p=49912 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:45:09,755 p=49912 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:45:09,756 p=49912 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:45:09,756 p=49912 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:45:10,143 p=49912 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** 2026-02-05 17:45:10,143 p=49912 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:45:11,304 p=49912 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** 2026-02-05 17:45:11,305 p=49912 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:45:12,329 p=49912 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** 2026-02-05 17:45:12,330 p=49912 u=1001930000 n=ansible WARNING| [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" 2026-02-05 17:45:12,331 p=49912 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. 2026-02-05 17:45:12,331 p=49912 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:45:13,361 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (30 retries left). 2026-02-05 17:45:19,265 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (29 retries left). 2026-02-05 17:45:25,236 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (28 retries left). 2026-02-05 17:45:31,160 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (27 retries left). 2026-02-05 17:45:37,088 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (26 retries left). 2026-02-05 17:45:43,051 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (25 retries left). 2026-02-05 17:45:48,988 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (24 retries left). 2026-02-05 17:45:54,946 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (23 retries left). 2026-02-05 17:46:00,883 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (22 retries left). 2026-02-05 17:46:06,829 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (21 retries left). 2026-02-05 17:46:12,781 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (20 retries left). 2026-02-05 17:46:18,744 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (19 retries left). 2026-02-05 17:46:24,680 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (18 retries left). 2026-02-05 17:46:30,641 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (17 retries left). 2026-02-05 17:46:36,930 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (16 retries left). 2026-02-05 17:46:43,067 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (15 retries left). 2026-02-05 17:46:49,092 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (14 retries left). 2026-02-05 17:46:55,104 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (13 retries left). 2026-02-05 17:47:01,110 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (12 retries left). 2026-02-05 17:47:07,073 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (11 retries left). 2026-02-05 17:47:13,041 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (10 retries left). 2026-02-05 17:47:18,994 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (9 retries left). 2026-02-05 17:47:24,982 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (8 retries left). 2026-02-05 17:47:30,989 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (7 retries left). 2026-02-05 17:47:36,944 p=49912 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** 2026-02-05 17:47:36,945 p=49912 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:47:39,256 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). 2026-02-05 17:47:44,721 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). 2026-02-05 17:47:50,206 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). 2026-02-05 17:47:55,629 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). 2026-02-05 17:48:01,042 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). 2026-02-05 17:48:06,480 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). 2026-02-05 17:48:11,898 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). 2026-02-05 17:48:17,307 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). 2026-02-05 17:48:22,717 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). 2026-02-05 17:48:28,132 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). 2026-02-05 17:48:33,540 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). 2026-02-05 17:48:38,966 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). 2026-02-05 17:48:44,383 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). 2026-02-05 17:48:49,997 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). 2026-02-05 17:48:55,405 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). 2026-02-05 17:49:00,796 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). 2026-02-05 17:49:06,196 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). 2026-02-05 17:49:11,843 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). 2026-02-05 17:49:17,505 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). 2026-02-05 17:49:23,188 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). 2026-02-05 17:49:28,629 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). 2026-02-05 17:49:34,054 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). 2026-02-05 17:49:39,475 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). 2026-02-05 17:49:44,868 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). 2026-02-05 17:49:50,535 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). 2026-02-05 17:49:56,344 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). 2026-02-05 17:50:02,077 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). 2026-02-05 17:50:07,558 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). 2026-02-05 17:50:12,980 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). 2026-02-05 17:50:18,451 p=49912 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). 2026-02-05 17:50:23,868 p=49912 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** 2026-02-05 17:50:23,868 p=49912 u=1001930000 n=ansible ERROR| [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3 50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal) ^ column 3 2026-02-05 17:50:23,869 p=49912 u=1001930000 n=ansible INFO| fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-440 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.186164", "end": "2026-02-05 17:50:23.840791", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 17:50:23.654627", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} 2026-02-05 17:50:23,870 p=49912 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 17:50:23,870 p=49912 u=1001930000 n=ansible INFO| localhost : ok=20 changed=5 unreachable=0 failed=1 skipped=3 rescued=0 ignored=0 Run the command: oc get event -n test-oadp-440 2026/02/05 17:50:24 LAST SEEN TYPE REASON OBJECT MESSAGE 9m26s Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m26s Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m26s Normal Scheduled pod/cassandra-0 Successfully assigned test-oadp-440/cassandra-0 to ip-10-0-60-83.us-east-2.compute.internal 9m26s Normal SuccessfulAttachVolume pod/cassandra-0 AttachVolume.Attach succeeded for volume "pvc-b1dec212-da28-4a61-a0e3-5e8a586d62b0" 9m21s Normal AddedInterface pod/cassandra-0 Add eth0 [10.129.2.197/23] from ovn-kubernetes 2m52s Normal Pulling pod/cassandra-0 Pulling image "quay.io/migqe/cassandra:multiarch" 9m20s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 805ms (805ms including waiting). Image size: 307783610 bytes. 5m46s Normal Created pod/cassandra-0 Created container: cassandra 5m46s Normal Started pod/cassandra-0 Started container cassandra 9m12s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 535ms (535ms including waiting). Image size: 307783610 bytes. 3m19s Warning BackOff pod/cassandra-0 Back-off restarting failed container cassandra in pod cassandra-0_test-oadp-440(d2d0ef44-620e-4d38-9652-e873d770d93b) 8m52s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 505ms (505ms including waiting). Image size: 307783610 bytes. 8m17s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 717ms (717ms including waiting). Image size: 307783610 bytes. 7m20s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 955ms (955ms including waiting). Image size: 307783610 bytes. 5m46s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 480ms (480ms including waiting). Image size: 307783610 bytes. 2m51s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 1.002s (1.002s including waiting). Image size: 307783610 bytes. 9m19s Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m19s Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m19s Normal Scheduled pod/cassandra-1 Successfully assigned test-oadp-440/cassandra-1 to ip-10-0-98-206.us-east-2.compute.internal 9m19s Normal SuccessfulAttachVolume pod/cassandra-1 AttachVolume.Attach succeeded for volume "pvc-ad1953af-1f28-415c-a7cf-4cdd1aae19ad" 9m10s Normal AddedInterface pod/cassandra-1 Add eth0 [10.131.0.90/23] from ovn-kubernetes 2m48s Normal Pulling pod/cassandra-1 Pulling image "quay.io/migqe/cassandra:multiarch" 9m10s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 483ms (483ms including waiting). Image size: 307783610 bytes. 5m45s Normal Created pod/cassandra-1 Created container: cassandra 5m45s Normal Started pod/cassandra-1 Started container cassandra 9m4s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 478ms (478ms including waiting). Image size: 307783610 bytes. 3m3s Warning BackOff pod/cassandra-1 Back-off restarting failed container cassandra in pod cassandra-1_test-oadp-440(23df954f-e68d-454e-8910-6e5968124d6e) 8m49s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 386ms (386ms including waiting). Image size: 307783610 bytes. 8m17s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 639ms (639ms including waiting). Image size: 307783610 bytes. 7m14s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 556ms (556ms including waiting). Image size: 307783610 bytes. 5m46s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 450ms (450ms including waiting). Image size: 307783610 bytes. 2m47s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 702ms (702ms including waiting). Image size: 307783610 bytes. 9m8s Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m7s Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m7s Normal Scheduled pod/cassandra-2 Successfully assigned test-oadp-440/cassandra-2 to ip-10-0-7-38.us-east-2.compute.internal 9m8s Normal SuccessfulAttachVolume pod/cassandra-2 AttachVolume.Attach succeeded for volume "pvc-695f3daa-09a5-4081-a5f7-a2f88f777011" 9m7s Normal AddedInterface pod/cassandra-2 Add eth0 [10.128.2.57/23] from ovn-kubernetes 2m45s Normal Pulling pod/cassandra-2 Pulling image "quay.io/migqe/cassandra:multiarch" 9m6s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 523ms (523ms including waiting). Image size: 307783610 bytes. 5m42s Normal Created pod/cassandra-2 Created container: cassandra 5m42s Normal Started pod/cassandra-2 Started container cassandra 9m1s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 397ms (397ms including waiting). Image size: 307783610 bytes. 2m57s Warning BackOff pod/cassandra-2 Back-off restarting failed container cassandra in pod cassandra-2_test-oadp-440(fb543948-b0ac-4143-81d7-e708be1e27db) 8m41s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 566ms (566ms including waiting). Image size: 307783610 bytes. 8m10s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 813ms (813ms including waiting). Image size: 307783610 bytes. 7m20s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 519ms (519ms including waiting). Image size: 307783610 bytes. 5m42s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 570ms (570ms including waiting). Image size: 307783610 bytes. 2m45s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 435ms (435ms including waiting). Image size: 307783610 bytes. 9m27s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-0 External provisioner is provisioning volume for claim "test-oadp-440/cassandra-data-cassandra-0" 9m27s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-0 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 9m27s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-0 Successfully provisioned volume pvc-b1dec212-da28-4a61-a0e3-5e8a586d62b0 9m20s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-1 External provisioner is provisioning volume for claim "test-oadp-440/cassandra-data-cassandra-1" 9m20s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-1 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 9m20s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-1 Successfully provisioned volume pvc-ad1953af-1f28-415c-a7cf-4cdd1aae19ad 9m9s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-2 External provisioner is provisioning volume for claim "test-oadp-440/cassandra-data-cassandra-2" 9m9s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-2 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 9m8s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-2 Successfully provisioned volume pvc-695f3daa-09a5-4081-a5f7-a2f88f777011 9m27s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-0 Pod cassandra-0 in StatefulSet cassandra success 9m27s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-0 in StatefulSet cassandra successful 9m20s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-1 Pod cassandra-1 in StatefulSet cassandra success 9m20s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-1 in StatefulSet cassandra successful 9m9s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-2 Pod cassandra-2 in StatefulSet cassandra success 9m9s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-2 in StatefulSet cassandra successful 2026/02/05 17:50:24 Found server error pattern in ansible logs: '502' 2026/02/05 17:50:24 Detected server errors in ansible logs - treating as retryable 2026/02/05 17:50:24 ⚠️ Operation 'Deploy application ocp-cassandra' failed with retryable server error (attempt 2/3): Error during command execution: ansible-playbook error: one or more host failed Command executed: /usr/local/bin/ansible-playbook --extra-vars {"admin_kubeconfig":"/home/jenkins/.kube/config","namespace":"test-oadp-440","non_admin_user":false,"use_role":"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra","user_kubeconfig":"/home/jenkins/.kube/config","with_deploy":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml exit status 2 2026/02/05 17:50:24 🕐 Waiting 2m0s before retry... 2026/02/05 17:52:24 🔄 [Attempt 3/3] Executing operation: Deploy application ocp-cassandra 2026/02/05 17:52:24 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** ok: [localhost] [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** ok: [localhost] FAILED - RETRYING: [localhost]: Check pods status (30 retries left). FAILED - RETRYING: [localhost]: Check pods status (29 retries left). FAILED - RETRYING: [localhost]: Check pods status (28 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** ok: [localhost] FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3  50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal)  ^ column 3  fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-440 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.192310", "end": "2026-02-05 17:55:35.718075", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 17:55:35.525765", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} PLAY RECAP ********************************************************************* localhost : ok=20  changed=5  unreachable=0 failed=1  skipped=3  rescued=0 ignored=0 2026/02/05 17:55:35 2026-02-05 17:52:25,854 p=51481 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 17:52:25,854 p=51481 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:52:26,183 p=51481 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 17:52:26,183 p=51481 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:52:26,511 p=51481 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 17:52:26,511 p=51481 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:52:26,846 p=51481 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 17:52:26,846 p=51481 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:52:26,868 p=51481 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 17:52:26,868 p=51481 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 17:52:26,868 p=51481 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:52:26,890 p=51481 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 17:52:26,890 p=51481 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:52:26,906 p=51481 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 17:52:26,906 p=51481 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 17:52:27,361 p=51481 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 17:52:27,361 p=51481 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 17:52:27,362 p=51481 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 17:52:27,362 p=51481 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:52:27,392 p=51481 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 17:52:27,392 p=51481 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:52:27,416 p=51481 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 17:52:27,416 p=51481 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:52:27,419 p=51481 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 17:52:28,093 p=51481 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 17:52:28,093 p=51481 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:52:29,289 p=51481 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** 2026-02-05 17:52:29,290 p=51481 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 17:52:29,290 p=51481 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:52:29,291 p=51481 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:52:29,291 p=51481 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:52:29,291 p=51481 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:52:29,694 p=51481 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** 2026-02-05 17:52:29,694 p=51481 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:52:30,947 p=51481 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** 2026-02-05 17:52:30,947 p=51481 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:52:31,980 p=51481 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** 2026-02-05 17:52:31,981 p=51481 u=1001930000 n=ansible WARNING| [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" 2026-02-05 17:52:31,982 p=51481 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. 2026-02-05 17:52:31,982 p=51481 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:52:33,023 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (30 retries left). 2026-02-05 17:52:39,014 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (29 retries left). 2026-02-05 17:52:44,915 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (28 retries left). 2026-02-05 17:52:50,821 p=51481 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** 2026-02-05 17:52:50,822 p=51481 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:52:51,275 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). 2026-02-05 17:52:59,037 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). 2026-02-05 17:53:04,442 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). 2026-02-05 17:53:09,847 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). 2026-02-05 17:53:15,251 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). 2026-02-05 17:53:20,651 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). 2026-02-05 17:53:26,066 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). 2026-02-05 17:53:31,461 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). 2026-02-05 17:53:36,865 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). 2026-02-05 17:53:42,263 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). 2026-02-05 17:53:47,660 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). 2026-02-05 17:53:53,052 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). 2026-02-05 17:53:58,463 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). 2026-02-05 17:54:03,857 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). 2026-02-05 17:54:09,263 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). 2026-02-05 17:54:14,655 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). 2026-02-05 17:54:20,055 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). 2026-02-05 17:54:25,454 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). 2026-02-05 17:54:30,833 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). 2026-02-05 17:54:36,290 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). 2026-02-05 17:54:41,684 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). 2026-02-05 17:54:47,078 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). 2026-02-05 17:54:52,470 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). 2026-02-05 17:54:57,870 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). 2026-02-05 17:55:03,256 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). 2026-02-05 17:55:08,655 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). 2026-02-05 17:55:14,061 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). 2026-02-05 17:55:19,454 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). 2026-02-05 17:55:24,855 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). 2026-02-05 17:55:30,303 p=51481 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). 2026-02-05 17:55:35,751 p=51481 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** 2026-02-05 17:55:35,752 p=51481 u=1001930000 n=ansible ERROR| [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3 50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal) ^ column 3 2026-02-05 17:55:35,752 p=51481 u=1001930000 n=ansible INFO| fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-440 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.192310", "end": "2026-02-05 17:55:35.718075", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 17:55:35.525765", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} 2026-02-05 17:55:35,753 p=51481 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 17:55:35,753 p=51481 u=1001930000 n=ansible INFO| localhost : ok=20 changed=5 unreachable=0 failed=1 skipped=3 rescued=0 ignored=0 Run the command: oc get event -n test-oadp-440 2026/02/05 17:55:35 LAST SEEN TYPE REASON OBJECT MESSAGE 14m Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Normal Scheduled pod/cassandra-0 Successfully assigned test-oadp-440/cassandra-0 to ip-10-0-60-83.us-east-2.compute.internal 14m Normal SuccessfulAttachVolume pod/cassandra-0 AttachVolume.Attach succeeded for volume "pvc-b1dec212-da28-4a61-a0e3-5e8a586d62b0" 14m Normal AddedInterface pod/cassandra-0 Add eth0 [10.129.2.197/23] from ovn-kubernetes 2m43s Normal Pulling pod/cassandra-0 Pulling image "quay.io/migqe/cassandra:multiarch" 14m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 805ms (805ms including waiting). Image size: 307783610 bytes. 10m Normal Created pod/cassandra-0 Created container: cassandra 10m Normal Started pod/cassandra-0 Started container cassandra 14m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 535ms (535ms including waiting). Image size: 307783610 bytes. 4m10s Warning BackOff pod/cassandra-0 Back-off restarting failed container cassandra in pod cassandra-0_test-oadp-440(d2d0ef44-620e-4d38-9652-e873d770d93b) 14m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 505ms (505ms including waiting). Image size: 307783610 bytes. 13m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 717ms (717ms including waiting). Image size: 307783610 bytes. 12m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 955ms (955ms including waiting). Image size: 307783610 bytes. 10m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 480ms (480ms including waiting). Image size: 307783610 bytes. 8m2s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 1.002s (1.002s including waiting). Image size: 307783610 bytes. 14m Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Normal Scheduled pod/cassandra-1 Successfully assigned test-oadp-440/cassandra-1 to ip-10-0-98-206.us-east-2.compute.internal 14m Normal SuccessfulAttachVolume pod/cassandra-1 AttachVolume.Attach succeeded for volume "pvc-ad1953af-1f28-415c-a7cf-4cdd1aae19ad" 14m Normal AddedInterface pod/cassandra-1 Add eth0 [10.131.0.90/23] from ovn-kubernetes 2m46s Normal Pulling pod/cassandra-1 Pulling image "quay.io/migqe/cassandra:multiarch" 14m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 483ms (483ms including waiting). Image size: 307783610 bytes. 10m Normal Created pod/cassandra-1 Created container: cassandra 10m Normal Started pod/cassandra-1 Started container cassandra 14m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 478ms (478ms including waiting). Image size: 307783610 bytes. 4m9s Warning BackOff pod/cassandra-1 Back-off restarting failed container cassandra in pod cassandra-1_test-oadp-440(23df954f-e68d-454e-8910-6e5968124d6e) 14m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 386ms (386ms including waiting). Image size: 307783610 bytes. 13m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 639ms (639ms including waiting). Image size: 307783610 bytes. 12m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 556ms (556ms including waiting). Image size: 307783610 bytes. 10m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 450ms (450ms including waiting). Image size: 307783610 bytes. 7m58s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 702ms (702ms including waiting). Image size: 307783610 bytes. 14m Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Normal Scheduled pod/cassandra-2 Successfully assigned test-oadp-440/cassandra-2 to ip-10-0-7-38.us-east-2.compute.internal 14m Normal SuccessfulAttachVolume pod/cassandra-2 AttachVolume.Attach succeeded for volume "pvc-695f3daa-09a5-4081-a5f7-a2f88f777011" 14m Normal AddedInterface pod/cassandra-2 Add eth0 [10.128.2.57/23] from ovn-kubernetes 2m38s Normal Pulling pod/cassandra-2 Pulling image "quay.io/migqe/cassandra:multiarch" 14m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 523ms (523ms including waiting). Image size: 307783610 bytes. 10m Normal Created pod/cassandra-2 Created container: cassandra 10m Normal Started pod/cassandra-2 Started container cassandra 14m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 397ms (397ms including waiting). Image size: 307783610 bytes. 4m4s Warning BackOff pod/cassandra-2 Back-off restarting failed container cassandra in pod cassandra-2_test-oadp-440(fb543948-b0ac-4143-81d7-e708be1e27db) 13m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 566ms (566ms including waiting). Image size: 307783610 bytes. 13m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 813ms (813ms including waiting). Image size: 307783610 bytes. 12m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 519ms (519ms including waiting). Image size: 307783610 bytes. 10m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 570ms (570ms including waiting). Image size: 307783610 bytes. 7m56s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 435ms (435ms including waiting). Image size: 307783610 bytes. 14m Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-0 External provisioner is provisioning volume for claim "test-oadp-440/cassandra-data-cassandra-0" 14m Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-0 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 14m Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-0 Successfully provisioned volume pvc-b1dec212-da28-4a61-a0e3-5e8a586d62b0 14m Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-1 External provisioner is provisioning volume for claim "test-oadp-440/cassandra-data-cassandra-1" 14m Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-1 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 14m Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-1 Successfully provisioned volume pvc-ad1953af-1f28-415c-a7cf-4cdd1aae19ad 14m Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-2 External provisioner is provisioning volume for claim "test-oadp-440/cassandra-data-cassandra-2" 14m Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-2 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 14m Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-2 Successfully provisioned volume pvc-695f3daa-09a5-4081-a5f7-a2f88f777011 14m Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-0 Pod cassandra-0 in StatefulSet cassandra success 14m Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-0 in StatefulSet cassandra successful 14m Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-1 Pod cassandra-1 in StatefulSet cassandra success 14m Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-1 in StatefulSet cassandra successful 14m Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-2 Pod cassandra-2 in StatefulSet cassandra success 14m Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-2 in StatefulSet cassandra successful 2026/02/05 17:55:35 Found server error pattern in ansible logs: '502' 2026/02/05 17:55:35 Detected server errors in ansible logs - treating as retryable 2026/02/05 17:55:35 ❌ Operation 'Deploy application ocp-cassandra' failed after 3 attempts. Final error: Error during command execution: ansible-playbook error: one or more host failed Command executed: /usr/local/bin/ansible-playbook --extra-vars {"admin_kubeconfig":"/home/jenkins/.kube/config","namespace":"test-oadp-440","non_admin_user":false,"use_role":"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra","user_kubeconfig":"/home/jenkins/.kube/config","with_deploy":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml exit status 2 [FAILED] in [It] - /alabama/cspi/test_common/backup_restore_app_case.go:49 @ 02/05/26 17:55:35.951 < Exit [It] [tc-id:OADP-440][interop] [Tier0] [vf:data-mover] Cassandra application @ 02/05/26 17:55:35.952 (14m52.038s) > Enter [JustAfterEach] TOP-LEVEL @ 02/05/26 17:55:35.952 2026/02/05 17:55:35 Using Must-gather image: registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 STEP: Get the failed spec name @ 02/05/26 17:55:35.952 2026/02/05 17:55:35 The failed spec name is: [datamover] DataMover: Backup/Restore stateful application with CSI [tc-id:OADP-440][interop] [Tier0] [vf:data-mover] Cassandra application STEP: Create a folder for all must-gather files if it doesn't exists already @ 02/05/26 17:55:35.952 STEP: Create a folder for the failed spec if it doesn't exists already @ 02/05/26 17:55:35.952 2026/02/05 17:55:35 The folder logs/It_datamover_DataMover_Backup_Restore_stateful_application_with_CSI_tc-id_OADP-440_interop_Tier0_vf_data-mover_Cassandra_application does not exists, creating new folder with the name: logs/It_datamover_DataMover_Backup_Restore_stateful_application_with_CSI_tc-id_OADP-440_interop_Tier0_vf_data-mover_Cassandra_application STEP: Run must-gather because the spec failed @ 02/05/26 17:55:35.952 2026/02/05 17:55:35 Log the present working directory path:- /alabama/cspi/e2e 2026/02/05 17:55:35 [adm must-gather --dest-dir /alabama/cspi/e2e/logs/It_datamover_DataMover_Backup_Restore_stateful_application_with_CSI_tc-id_OADP-440_interop_Tier0_vf_data-mover_Cassandra_application --image registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3] 2026/02/05 17:55:55 Log all the files present in /alabama/cspi/e2e/logs directory 2026/02/05 17:55:55 It_Backup_hooks_tests_Pre_exec_hook_tc-id_OADP-92_interop_smoke_Tier0_vf_backup-hooks_Cassandra_app_with_Restic 2026/02/05 17:55:55 It_datamover_DataMover_Backup_Restore_stateful_application_with_CSI_tc-id_OADP-440_interop_Tier0_vf_data-mover_Cassandra_application STEP: Find must-gather folder and rename it to a shorter more readable name @ 02/05/26 17:55:55.236 Secret deletion flag: true Deleting cloud credentials secret cloud-credentials in namespace openshift-adp < Exit [JustAfterEach] TOP-LEVEL @ 02/05/26 17:55:55.253 (19.302s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 17:55:55.253 2026/02/05 17:55:55 Cleaning app 2026/02/05 17:55:55 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Remove namespace test-oadp-440] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=16  changed=5  unreachable=0 failed=0 skipped=22  rescued=0 ignored=0 2026/02/05 17:56:25 2026-02-05 17:55:57,036 p=52875 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 17:55:57,036 p=52875 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:55:57,354 p=52875 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 17:55:57,354 p=52875 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:55:57,687 p=52875 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 17:55:57,688 p=52875 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:55:58,030 p=52875 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 17:55:58,030 p=52875 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:55:58,048 p=52875 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 17:55:58,048 p=52875 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 17:55:58,048 p=52875 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:55:58,068 p=52875 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 17:55:58,068 p=52875 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:55:58,082 p=52875 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 17:55:58,083 p=52875 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 17:55:58,500 p=52875 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 17:55:58,501 p=52875 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 17:55:58,501 p=52875 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 17:55:58,501 p=52875 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:55:58,530 p=52875 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 17:55:58,530 p=52875 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:55:58,553 p=52875 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 17:55:58,553 p=52875 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:55:58,556 p=52875 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 17:55:59,169 p=52875 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 17:55:59,169 p=52875 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:56:25,344 p=52875 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Remove namespace test-oadp-440] *** 2026-02-05 17:56:25,344 p=52875 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 17:56:25,345 p=52875 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:56:25,345 p=52875 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:56:25,345 p=52875 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:56:25,345 p=52875 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:56:25,725 p=52875 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 17:56:25,725 p=52875 u=1001930000 n=ansible INFO| localhost : ok=16 changed=5 unreachable=0 failed=0 skipped=22 rescued=0 ignored=0 < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 17:56:25.781 (30.528s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 17:56:25.782 2026/02/05 17:56:25 Cleaning setup resources for the backup 2026/02/05 17:56:25 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 17:56:25 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2026/02/05 17:56:25 Deleting VolumeSnapshotClass 'example-snapclass' < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 17:56:25.804 (23ms) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 17:56:25.804 2026/02/05 17:56:25 Deleting DPA CR < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 17:56:25.815 (11ms) Attempt #1 Failed. Retrying ↺ @ 02/05/26 17:56:25.815 > Enter [BeforeEach] TOP-LEVEL @ 02/05/26 17:56:25.815 < Exit [BeforeEach] TOP-LEVEL @ 02/05/26 17:56:25.815 (0s) > Enter [BeforeEach] [datamover] DataMover: Backup/Restore stateful application with CSI @ 02/05/26 17:56:25.815 < Exit [BeforeEach] [datamover] DataMover: Backup/Restore stateful application with CSI @ 02/05/26 17:56:25.825 (9ms) > Enter [JustBeforeEach] TOP-LEVEL @ 02/05/26 17:56:25.825 < Exit [JustBeforeEach] TOP-LEVEL @ 02/05/26 17:56:25.825 (0s) > Enter [It] [tc-id:OADP-440][interop] [Tier0] [vf:data-mover] Cassandra application @ 02/05/26 17:56:25.825 2026/02/05 17:56:25 Delete all downloadrequest mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-1cffc96c-d4e0-4901-ae6c-e2e8080ba42f mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-5eff3e03-0788-4d60-8d1c-86fe3225d30a mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-634d39d6-67c3-49e9-b9fe-4e1e113a70c2 mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-6ec886a2-f4ce-4b0f-b578-2916b731cf5b mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-926c54e5-e492-4a72-a159-6335cca41f88 mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-af410b2e-b533-4a2f-afad-d1494ebf0f59 mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-c4f1823f-aa05-4d60-b09f-35503f5d7393 mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-d0e1e63e-368f-40ee-9cb8-f5f7370325d4 mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-d8d34d13-8ef5-4c06-a0da-26ae03d65d17 ocp-datavolume-5d53c5a8-02b2-11f1-a828-0a58ac1896e8-262b5e39-db1b-4f00-b8d8-335ba86fd068 ocp-datavolume-5d53c5a8-02b2-11f1-a828-0a58ac1896e8-7b0690b8-e585-4fb7-ab11-612f335a5108 STEP: Create DPA CR @ 02/05/26 17:56:26.047 2026/02/05 17:56:26 native-datamover 2026/02/05 17:56:26 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "0d12d3cc-f082-47e4-adff-869befb4b8b6", "resourceVersion": "156940", "generation": 1, "creationTimestamp": "2026-02-05T17:56:26Z", "managedFields": [ { "manager": "e2e.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T17:56:26Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:nodeAgent": { ".": {}, "f:enable": {}, "f:podConfig": { ".": {}, "f:resourceAllocations": {} }, "f:uploaderType": {} }, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false }, "nodeAgent": { "enable": true, "podConfig": { "resourceAllocations": {} }, "uploaderType": "kopia" } }, "features": null, "logFormat": "text" }, "status": {} } Delete all the backups that remained in the phase InProgress Deleting backup CRs in progress Deletion of backup CRs in progress completed Delete all the restores that remained in the phase InProgress Deleting restore CRs in progress Deletion of restore CRs in progress completed STEP: Verify DPA CR setup @ 02/05/26 17:56:26.078 2026/02/05 17:56:26 Waiting for velero pod to be running 2026/02/05 17:56:26 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete' 2026/02/05 17:56:26 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "0d12d3cc-f082-47e4-adff-869befb4b8b6", "resourceVersion": "156940", "generation": 1, "creationTimestamp": "2026-02-05T17:56:26Z", "managedFields": [ { "manager": "e2e.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T17:56:26Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:nodeAgent": { ".": {}, "f:enable": {}, "f:podConfig": { ".": {}, "f:resourceAllocations": {} }, "f:uploaderType": {} }, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false }, "nodeAgent": { "enable": true, "podConfig": { "resourceAllocations": {} }, "uploaderType": "kopia" } }, "features": null, "logFormat": "text" }, "status": {} } 2026/02/05 17:56:31 DPA successfully reconciled STEP: Prepare backup resources, depending on the volumes backup type @ 02/05/26 17:56:31.098 2026/02/05 17:56:31 Snapclass 'example-snapclass' doesn't exist, creating 2026/02/05 17:56:31 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 17:56:31 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2026/02/05 17:56:31 Checking for correct number of running NodeAgent pods... STEP: Installing application for case cassandra-e2e @ 02/05/26 17:56:31.236 2026/02/05 17:56:31 🔄 [Attempt 1/3] Executing operation: Deploy application ocp-cassandra 2026/02/05 17:56:31 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create namespace] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** changed: [localhost] [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** changed: [localhost] FAILED - RETRYING: [localhost]: Check pods status (30 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** ok: [localhost] FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3  50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal)  ^ column 3  fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-440 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.337906", "end": "2026-02-05 17:59:48.181795", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 17:59:47.843889", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} PLAY RECAP ********************************************************************* localhost : ok=21  changed=8  unreachable=0 failed=1  skipped=2  rescued=0 ignored=0 2026/02/05 17:59:48 2026-02-05 17:56:33,147 p=53105 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 17:56:33,147 p=53105 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:56:33,492 p=53105 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 17:56:33,492 p=53105 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:56:33,843 p=53105 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 17:56:33,843 p=53105 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:56:34,179 p=53105 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 17:56:34,179 p=53105 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:56:34,199 p=53105 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 17:56:34,199 p=53105 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 17:56:34,199 p=53105 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:56:34,222 p=53105 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 17:56:34,223 p=53105 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:56:34,239 p=53105 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 17:56:34,240 p=53105 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 17:56:34,747 p=53105 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 17:56:34,748 p=53105 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 17:56:34,748 p=53105 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 17:56:34,748 p=53105 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:56:34,782 p=53105 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 17:56:34,782 p=53105 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:56:34,810 p=53105 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 17:56:34,810 p=53105 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:56:34,813 p=53105 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 17:56:35,458 p=53105 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 17:56:35,458 p=53105 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:56:36,681 p=53105 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** 2026-02-05 17:56:36,682 p=53105 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 17:56:36,682 p=53105 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:56:36,682 p=53105 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:56:36,682 p=53105 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 17:56:36,682 p=53105 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:56:37,144 p=53105 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create namespace] *** 2026-02-05 17:56:37,144 p=53105 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:56:37,562 p=53105 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** 2026-02-05 17:56:37,562 p=53105 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:56:38,716 p=53105 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** 2026-02-05 17:56:38,718 p=53105 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:56:39,730 p=53105 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** 2026-02-05 17:56:39,730 p=53105 u=1001930000 n=ansible WARNING| [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" 2026-02-05 17:56:39,731 p=53105 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. 2026-02-05 17:56:39,731 p=53105 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 17:56:40,714 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (30 retries left). 2026-02-05 17:56:46,647 p=53105 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** 2026-02-05 17:56:46,648 p=53105 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 17:56:50,738 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). 2026-02-05 17:56:57,533 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). 2026-02-05 17:57:02,970 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). 2026-02-05 17:57:08,407 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). 2026-02-05 17:57:17,832 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). 2026-02-05 17:57:23,232 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). 2026-02-05 17:57:28,646 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). 2026-02-05 17:57:34,058 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). 2026-02-05 17:57:39,462 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). 2026-02-05 17:57:48,731 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). 2026-02-05 17:57:54,138 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). 2026-02-05 17:57:59,561 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). 2026-02-05 17:58:04,960 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). 2026-02-05 17:58:10,379 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). 2026-02-05 17:58:15,814 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). 2026-02-05 17:58:21,222 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). 2026-02-05 17:58:26,636 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). 2026-02-05 17:58:36,431 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). 2026-02-05 17:58:41,869 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). 2026-02-05 17:58:47,337 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). 2026-02-05 17:58:52,811 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). 2026-02-05 17:58:58,235 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). 2026-02-05 17:59:03,653 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). 2026-02-05 17:59:09,061 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). 2026-02-05 17:59:14,508 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). 2026-02-05 17:59:19,934 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). 2026-02-05 17:59:25,383 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). 2026-02-05 17:59:31,110 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). 2026-02-05 17:59:36,728 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). 2026-02-05 17:59:42,498 p=53105 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). 2026-02-05 17:59:48,236 p=53105 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** 2026-02-05 17:59:48,237 p=53105 u=1001930000 n=ansible ERROR| [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3 50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal) ^ column 3 2026-02-05 17:59:48,238 p=53105 u=1001930000 n=ansible INFO| fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-440 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.337906", "end": "2026-02-05 17:59:48.181795", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 17:59:47.843889", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} 2026-02-05 17:59:48,239 p=53105 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 17:59:48,239 p=53105 u=1001930000 n=ansible INFO| localhost : ok=21 changed=8 unreachable=0 failed=1 skipped=2 rescued=0 ignored=0 Run the command: oc get event -n test-oadp-440 2026/02/05 17:59:48 LAST SEEN TYPE REASON OBJECT MESSAGE 3m8s Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 3m8s Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 3m8s Normal Scheduled pod/cassandra-0 Successfully assigned test-oadp-440/cassandra-0 to ip-10-0-60-83.us-east-2.compute.internal 3m8s Normal SuccessfulAttachVolume pod/cassandra-0 AttachVolume.Attach succeeded for volume "pvc-3cf5679e-2ce5-432f-87a4-5e89db0f8e48" 3m5s Normal AddedInterface pod/cassandra-0 Add eth0 [10.129.2.216/23] from ovn-kubernetes 78s Normal Pulling pod/cassandra-0 Pulling image "quay.io/migqe/cassandra:multiarch" 3m4s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 503ms (503ms including waiting). Image size: 307783610 bytes. 78s Normal Created pod/cassandra-0 Created container: cassandra 78s Normal Started pod/cassandra-0 Started container cassandra 2m57s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 500ms (500ms including waiting). Image size: 307783610 bytes. 7s Warning BackOff pod/cassandra-0 Back-off restarting failed container cassandra in pod cassandra-0_test-oadp-440(9b078ea2-898d-4496-ad16-cf6acdb88303) 2m37s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 413ms (413ms including waiting). Image size: 307783610 bytes. 2m5s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 414ms (414ms including waiting). Image size: 307783610 bytes. 78s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 439ms (439ms including waiting). Image size: 307783610 bytes. 3m3s Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 3m3s Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 3m3s Normal Scheduled pod/cassandra-1 Successfully assigned test-oadp-440/cassandra-1 to ip-10-0-98-206.us-east-2.compute.internal 3m2s Normal SuccessfulAttachVolume pod/cassandra-1 AttachVolume.Attach succeeded for volume "pvc-bc124737-51f9-4639-ae86-601d7f252cd3" 2m55s Normal AddedInterface pod/cassandra-1 Add eth0 [10.131.0.93/23] from ovn-kubernetes 63s Normal Pulling pod/cassandra-1 Pulling image "quay.io/migqe/cassandra:multiarch" 2m54s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 459ms (459ms including waiting). Image size: 307783610 bytes. 62s Normal Created pod/cassandra-1 Created container: cassandra 62s Normal Started pod/cassandra-1 Started container cassandra 2m49s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 492ms (492ms including waiting). Image size: 307783610 bytes. 10s Warning BackOff pod/cassandra-1 Back-off restarting failed container cassandra in pod cassandra-1_test-oadp-440(221d1644-c8b5-49b6-92e0-df6a854c530e) 2m34s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 461ms (461ms including waiting). Image size: 307783610 bytes. 2m4s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 457ms (457ms including waiting). Image size: 307783610 bytes. 62s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 539ms (539ms including waiting). Image size: 307783610 bytes. 2m53s Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 2m53s Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 2m53s Normal Scheduled pod/cassandra-2 Successfully assigned test-oadp-440/cassandra-2 to ip-10-0-7-38.us-east-2.compute.internal 2m53s Normal SuccessfulAttachVolume pod/cassandra-2 AttachVolume.Attach succeeded for volume "pvc-88897a63-d0a9-4baa-b839-dc964f1ad0a1" 2m43s Normal AddedInterface pod/cassandra-2 Add eth0 [10.128.2.59/23] from ovn-kubernetes 49s Normal Pulling pod/cassandra-2 Pulling image "quay.io/migqe/cassandra:multiarch" 2m42s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 494ms (494ms including waiting). Image size: 307783610 bytes. 49s Normal Created pod/cassandra-2 Created container: cassandra 49s Normal Started pod/cassandra-2 Started container cassandra 2m36s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 418ms (418ms including waiting). Image size: 307783610 bytes. 3s Warning BackOff pod/cassandra-2 Back-off restarting failed container cassandra in pod cassandra-2_test-oadp-440(8d301cf7-a3b9-4fd3-af65-92a20a92c2cc) 2m16s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 513ms (513ms including waiting). Image size: 307783610 bytes. 105s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 478ms (478ms including waiting). Image size: 307783610 bytes. 49s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 709ms (709ms including waiting). Image size: 307783610 bytes. 3m9s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-0 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 3m9s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-0 External provisioner is provisioning volume for claim "test-oadp-440/cassandra-data-cassandra-0" 3m9s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-0 Successfully provisioned volume pvc-3cf5679e-2ce5-432f-87a4-5e89db0f8e48 3m3s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-1 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 3m3s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-1 External provisioner is provisioning volume for claim "test-oadp-440/cassandra-data-cassandra-1" 3m3s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-1 Successfully provisioned volume pvc-bc124737-51f9-4639-ae86-601d7f252cd3 2m54s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-2 External provisioner is provisioning volume for claim "test-oadp-440/cassandra-data-cassandra-2" 2m54s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-2 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 2m53s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-2 Successfully provisioned volume pvc-88897a63-d0a9-4baa-b839-dc964f1ad0a1 3m9s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-0 Pod cassandra-0 in StatefulSet cassandra success 3m9s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-0 in StatefulSet cassandra successful 3m3s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-1 Pod cassandra-1 in StatefulSet cassandra success 3m3s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-1 in StatefulSet cassandra successful 2m54s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-2 Pod cassandra-2 in StatefulSet cassandra success 2m54s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-2 in StatefulSet cassandra successful 2026/02/05 17:59:48 Found server error pattern in ansible logs: '502' 2026/02/05 17:59:48 Detected server errors in ansible logs - treating as retryable 2026/02/05 17:59:48 ⚠️ Operation 'Deploy application ocp-cassandra' failed with retryable server error (attempt 1/3): Error during command execution: ansible-playbook error: one or more host failed Command executed: /usr/local/bin/ansible-playbook --extra-vars {"admin_kubeconfig":"/home/jenkins/.kube/config","namespace":"test-oadp-440","non_admin_user":false,"use_role":"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra","user_kubeconfig":"/home/jenkins/.kube/config","with_deploy":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml exit status 2 2026/02/05 17:59:48 🕐 Waiting 1m0s before retry... 2026/02/05 18:00:48 🔄 [Attempt 2/3] Executing operation: Deploy application ocp-cassandra 2026/02/05 18:00:48 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** ok: [localhost] [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** ok: [localhost] FAILED - RETRYING: [localhost]: Check pods status (30 retries left). FAILED - RETRYING: [localhost]: Check pods status (29 retries left). FAILED - RETRYING: [localhost]: Check pods status (28 retries left). FAILED - RETRYING: [localhost]: Check pods status (27 retries left). FAILED - RETRYING: [localhost]: Check pods status (26 retries left). FAILED - RETRYING: [localhost]: Check pods status (25 retries left). FAILED - RETRYING: [localhost]: Check pods status (24 retries left). FAILED - RETRYING: [localhost]: Check pods status (23 retries left). FAILED - RETRYING: [localhost]: Check pods status (22 retries left). FAILED - RETRYING: [localhost]: Check pods status (21 retries left). FAILED - RETRYING: [localhost]: Check pods status (20 retries left). FAILED - RETRYING: [localhost]: Check pods status (19 retries left). FAILED - RETRYING: [localhost]: Check pods status (18 retries left). FAILED - RETRYING: [localhost]: Check pods status (17 retries left). FAILED - RETRYING: [localhost]: Check pods status (16 retries left). FAILED - RETRYING: [localhost]: Check pods status (15 retries left). FAILED - RETRYING: [localhost]: Check pods status (14 retries left). FAILED - RETRYING: [localhost]: Check pods status (13 retries left). FAILED - RETRYING: [localhost]: Check pods status (12 retries left). FAILED - RETRYING: [localhost]: Check pods status (11 retries left). FAILED - RETRYING: [localhost]: Check pods status (10 retries left). FAILED - RETRYING: [localhost]: Check pods status (9 retries left). FAILED - RETRYING: [localhost]: Check pods status (8 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** ok: [localhost] FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3  50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal)  ^ column 3  fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-440 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.211937", "end": "2026-02-05 18:05:58.685809", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 18:05:58.473872", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} PLAY RECAP ********************************************************************* localhost : ok=20  changed=5  unreachable=0 failed=1  skipped=3  rescued=0 ignored=0 2026/02/05 18:05:58 2026-02-05 18:00:50,399 p=54432 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:00:50,399 p=54432 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:00:50,720 p=54432 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:00:50,720 p=54432 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:00:51,043 p=54432 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:00:51,044 p=54432 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:00:51,374 p=54432 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:00:51,374 p=54432 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:00:51,392 p=54432 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:00:51,393 p=54432 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:00:51,393 p=54432 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:00:51,416 p=54432 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:00:51,416 p=54432 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:00:51,434 p=54432 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:00:51,434 p=54432 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:00:51,870 p=54432 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:00:51,871 p=54432 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:00:51,871 p=54432 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:00:51,871 p=54432 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:00:51,900 p=54432 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:00:51,900 p=54432 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:00:51,924 p=54432 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:00:51,924 p=54432 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:00:51,928 p=54432 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:00:52,546 p=54432 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:00:52,546 p=54432 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:00:53,719 p=54432 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** 2026-02-05 18:00:53,719 p=54432 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:00:53,719 p=54432 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:00:53,720 p=54432 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:00:53,720 p=54432 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:00:53,720 p=54432 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:00:54,133 p=54432 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** 2026-02-05 18:00:54,133 p=54432 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:00:55,398 p=54432 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** 2026-02-05 18:00:55,399 p=54432 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:00:56,461 p=54432 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** 2026-02-05 18:00:56,461 p=54432 u=1001930000 n=ansible WARNING| [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" 2026-02-05 18:00:56,462 p=54432 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. 2026-02-05 18:00:56,462 p=54432 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:00:57,617 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (30 retries left). 2026-02-05 18:01:03,869 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (29 retries left). 2026-02-05 18:01:10,176 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (28 retries left). 2026-02-05 18:01:16,177 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (27 retries left). 2026-02-05 18:01:22,109 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (26 retries left). 2026-02-05 18:01:28,049 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (25 retries left). 2026-02-05 18:01:34,006 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (24 retries left). 2026-02-05 18:01:39,967 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (23 retries left). 2026-02-05 18:01:45,894 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (22 retries left). 2026-02-05 18:01:51,869 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (21 retries left). 2026-02-05 18:01:57,807 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (20 retries left). 2026-02-05 18:02:03,729 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (19 retries left). 2026-02-05 18:02:09,641 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (18 retries left). 2026-02-05 18:02:15,571 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (17 retries left). 2026-02-05 18:02:21,477 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (16 retries left). 2026-02-05 18:02:27,394 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (15 retries left). 2026-02-05 18:02:33,320 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (14 retries left). 2026-02-05 18:02:39,232 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (13 retries left). 2026-02-05 18:02:45,164 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (12 retries left). 2026-02-05 18:02:51,066 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (11 retries left). 2026-02-05 18:02:57,044 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (10 retries left). 2026-02-05 18:03:02,991 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (9 retries left). 2026-02-05 18:03:08,935 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (8 retries left). 2026-02-05 18:03:14,868 p=54432 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** 2026-02-05 18:03:14,869 p=54432 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:03:15,443 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). 2026-02-05 18:03:20,891 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). 2026-02-05 18:03:26,309 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). 2026-02-05 18:03:31,735 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). 2026-02-05 18:03:37,152 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). 2026-02-05 18:03:42,540 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). 2026-02-05 18:03:47,946 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). 2026-02-05 18:03:53,401 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). 2026-02-05 18:03:58,815 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). 2026-02-05 18:04:04,212 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). 2026-02-05 18:04:09,621 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). 2026-02-05 18:04:15,040 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). 2026-02-05 18:04:20,466 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). 2026-02-05 18:04:25,965 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). 2026-02-05 18:04:31,382 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). 2026-02-05 18:04:36,793 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). 2026-02-05 18:04:42,199 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). 2026-02-05 18:04:47,619 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). 2026-02-05 18:04:53,056 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). 2026-02-05 18:04:58,479 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). 2026-02-05 18:05:03,916 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). 2026-02-05 18:05:09,319 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). 2026-02-05 18:05:14,731 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). 2026-02-05 18:05:20,138 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). 2026-02-05 18:05:25,555 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). 2026-02-05 18:05:31,120 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). 2026-02-05 18:05:36,524 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). 2026-02-05 18:05:42,222 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). 2026-02-05 18:05:47,798 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). 2026-02-05 18:05:53,248 p=54432 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). 2026-02-05 18:05:58,717 p=54432 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** 2026-02-05 18:05:58,718 p=54432 u=1001930000 n=ansible ERROR| [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3 50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal) ^ column 3 2026-02-05 18:05:58,718 p=54432 u=1001930000 n=ansible INFO| fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-440 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.211937", "end": "2026-02-05 18:05:58.685809", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 18:05:58.473872", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} 2026-02-05 18:05:58,719 p=54432 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:05:58,719 p=54432 u=1001930000 n=ansible INFO| localhost : ok=20 changed=5 unreachable=0 failed=1 skipped=3 rescued=0 ignored=0 Run the command: oc get event -n test-oadp-440 2026/02/05 18:05:58 LAST SEEN TYPE REASON OBJECT MESSAGE 9m19s Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m18s Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m18s Normal Scheduled pod/cassandra-0 Successfully assigned test-oadp-440/cassandra-0 to ip-10-0-60-83.us-east-2.compute.internal 9m18s Normal SuccessfulAttachVolume pod/cassandra-0 AttachVolume.Attach succeeded for volume "pvc-3cf5679e-2ce5-432f-87a4-5e89db0f8e48" 9m15s Normal AddedInterface pod/cassandra-0 Add eth0 [10.129.2.216/23] from ovn-kubernetes 2m51s Normal Pulling pod/cassandra-0 Pulling image "quay.io/migqe/cassandra:multiarch" 9m14s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 503ms (503ms including waiting). Image size: 307783610 bytes. 5m48s Normal Created pod/cassandra-0 Created container: cassandra 5m48s Normal Started pod/cassandra-0 Started container cassandra 9m7s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 500ms (500ms including waiting). Image size: 307783610 bytes. 3m6s Warning BackOff pod/cassandra-0 Back-off restarting failed container cassandra in pod cassandra-0_test-oadp-440(9b078ea2-898d-4496-ad16-cf6acdb88303) 8m47s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 413ms (413ms including waiting). Image size: 307783610 bytes. 8m15s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 414ms (414ms including waiting). Image size: 307783610 bytes. 7m28s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 439ms (439ms including waiting). Image size: 307783610 bytes. 5m48s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 514ms (514ms including waiting). Image size: 307783610 bytes. 2m49s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 1.841s (1.841s including waiting). Image size: 307783610 bytes. 9m13s Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m13s Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m13s Normal Scheduled pod/cassandra-1 Successfully assigned test-oadp-440/cassandra-1 to ip-10-0-98-206.us-east-2.compute.internal 9m12s Normal SuccessfulAttachVolume pod/cassandra-1 AttachVolume.Attach succeeded for volume "pvc-bc124737-51f9-4639-ae86-601d7f252cd3" 9m5s Normal AddedInterface pod/cassandra-1 Add eth0 [10.131.0.93/23] from ovn-kubernetes 2m49s Normal Pulling pod/cassandra-1 Pulling image "quay.io/migqe/cassandra:multiarch" 9m4s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 459ms (459ms including waiting). Image size: 307783610 bytes. 5m34s Normal Created pod/cassandra-1 Created container: cassandra 5m34s Normal Started pod/cassandra-1 Started container cassandra 8m59s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 492ms (492ms including waiting). Image size: 307783610 bytes. 3m Warning BackOff pod/cassandra-1 Back-off restarting failed container cassandra in pod cassandra-1_test-oadp-440(221d1644-c8b5-49b6-92e0-df6a854c530e) 8m44s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 461ms (461ms including waiting). Image size: 307783610 bytes. 8m14s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 457ms (457ms including waiting). Image size: 307783610 bytes. 7m12s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 539ms (539ms including waiting). Image size: 307783610 bytes. 5m35s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 494ms (494ms including waiting). Image size: 307783610 bytes. 2m48s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 784ms (784ms including waiting). Image size: 307783610 bytes. 9m4s Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m3s Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m3s Normal Scheduled pod/cassandra-2 Successfully assigned test-oadp-440/cassandra-2 to ip-10-0-7-38.us-east-2.compute.internal 9m3s Normal SuccessfulAttachVolume pod/cassandra-2 AttachVolume.Attach succeeded for volume "pvc-88897a63-d0a9-4baa-b839-dc964f1ad0a1" 8m53s Normal AddedInterface pod/cassandra-2 Add eth0 [10.128.2.59/23] from ovn-kubernetes 2m32s Normal Pulling pod/cassandra-2 Pulling image "quay.io/migqe/cassandra:multiarch" 8m52s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 494ms (494ms including waiting). Image size: 307783610 bytes. 5m22s Normal Created pod/cassandra-2 Created container: cassandra 5m22s Normal Started pod/cassandra-2 Started container cassandra 8m46s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 418ms (418ms including waiting). Image size: 307783610 bytes. 3m2s Warning BackOff pod/cassandra-2 Back-off restarting failed container cassandra in pod cassandra-2_test-oadp-440(8d301cf7-a3b9-4fd3-af65-92a20a92c2cc) 8m26s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 513ms (513ms including waiting). Image size: 307783610 bytes. 7m55s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 478ms (478ms including waiting). Image size: 307783610 bytes. 6m59s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 709ms (709ms including waiting). Image size: 307783610 bytes. 5m22s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 515ms (515ms including waiting). Image size: 307783610 bytes. 2m32s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 646ms (646ms including waiting). Image size: 307783610 bytes. 9m19s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-0 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 9m19s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-0 External provisioner is provisioning volume for claim "test-oadp-440/cassandra-data-cassandra-0" 9m19s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-0 Successfully provisioned volume pvc-3cf5679e-2ce5-432f-87a4-5e89db0f8e48 9m13s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-1 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 9m13s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-1 External provisioner is provisioning volume for claim "test-oadp-440/cassandra-data-cassandra-1" 9m13s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-1 Successfully provisioned volume pvc-bc124737-51f9-4639-ae86-601d7f252cd3 9m4s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-2 External provisioner is provisioning volume for claim "test-oadp-440/cassandra-data-cassandra-2" 9m4s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-2 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 9m3s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-2 Successfully provisioned volume pvc-88897a63-d0a9-4baa-b839-dc964f1ad0a1 9m19s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-0 Pod cassandra-0 in StatefulSet cassandra success 9m19s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-0 in StatefulSet cassandra successful 9m13s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-1 Pod cassandra-1 in StatefulSet cassandra success 9m13s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-1 in StatefulSet cassandra successful 9m4s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-2 Pod cassandra-2 in StatefulSet cassandra success 9m4s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-2 in StatefulSet cassandra successful 2026/02/05 18:05:58 Found server error pattern in ansible logs: '401' 2026/02/05 18:05:58 Detected server errors in ansible logs - treating as retryable 2026/02/05 18:05:58 ⚠️ Operation 'Deploy application ocp-cassandra' failed with retryable server error (attempt 2/3): Error during command execution: ansible-playbook error: one or more host failed Command executed: /usr/local/bin/ansible-playbook --extra-vars {"admin_kubeconfig":"/home/jenkins/.kube/config","namespace":"test-oadp-440","non_admin_user":false,"use_role":"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra","user_kubeconfig":"/home/jenkins/.kube/config","with_deploy":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml exit status 2 2026/02/05 18:05:58 🕐 Waiting 2m0s before retry... 2026/02/05 18:07:58 🔄 [Attempt 3/3] Executing operation: Deploy application ocp-cassandra 2026/02/05 18:07:58 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** ok: [localhost] [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** ok: [localhost] FAILED - RETRYING: [localhost]: Check pods status (30 retries left). FAILED - RETRYING: [localhost]: Check pods status (29 retries left). FAILED - RETRYING: [localhost]: Check pods status (28 retries left). FAILED - RETRYING: [localhost]: Check pods status (27 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** ok: [localhost] FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3  50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal)  ^ column 3  fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-440 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.180324", "end": "2026-02-05 18:11:14.595350", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 18:11:14.415026", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} PLAY RECAP ********************************************************************* localhost : ok=20  changed=5  unreachable=0 failed=1  skipped=3  rescued=0 ignored=0 2026/02/05 18:11:14 2026-02-05 18:08:00,718 p=56020 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:08:00,719 p=56020 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:08:01,054 p=56020 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:08:01,055 p=56020 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:08:01,374 p=56020 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:08:01,375 p=56020 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:08:01,720 p=56020 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:08:01,721 p=56020 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:08:01,741 p=56020 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:08:01,742 p=56020 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:08:01,742 p=56020 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:08:01,767 p=56020 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:08:01,767 p=56020 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:08:01,784 p=56020 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:08:01,785 p=56020 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:08:02,254 p=56020 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:08:02,254 p=56020 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:08:02,254 p=56020 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:08:02,254 p=56020 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:08:02,283 p=56020 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:08:02,283 p=56020 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:08:02,308 p=56020 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:08:02,308 p=56020 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:08:02,311 p=56020 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:08:02,956 p=56020 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:08:02,956 p=56020 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:08:04,203 p=56020 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** 2026-02-05 18:08:04,203 p=56020 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:08:04,203 p=56020 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:08:04,204 p=56020 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:08:04,204 p=56020 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:08:04,204 p=56020 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:08:04,634 p=56020 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** 2026-02-05 18:08:04,634 p=56020 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:08:05,900 p=56020 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** 2026-02-05 18:08:05,900 p=56020 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:08:06,994 p=56020 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** 2026-02-05 18:08:06,994 p=56020 u=1001930000 n=ansible WARNING| [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" 2026-02-05 18:08:06,995 p=56020 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. 2026-02-05 18:08:06,995 p=56020 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:08:08,087 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (30 retries left). 2026-02-05 18:08:14,011 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (29 retries left). 2026-02-05 18:08:19,942 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (28 retries left). 2026-02-05 18:08:25,864 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (27 retries left). 2026-02-05 18:08:31,773 p=56020 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** 2026-02-05 18:08:31,774 p=56020 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:08:32,210 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). 2026-02-05 18:08:37,604 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). 2026-02-05 18:08:43,000 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). 2026-02-05 18:08:48,397 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). 2026-02-05 18:08:53,825 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). 2026-02-05 18:08:59,231 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). 2026-02-05 18:09:04,646 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). 2026-02-05 18:09:10,045 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). 2026-02-05 18:09:15,469 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). 2026-02-05 18:09:20,857 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). 2026-02-05 18:09:26,311 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). 2026-02-05 18:09:31,912 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). 2026-02-05 18:09:37,309 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). 2026-02-05 18:09:42,698 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). 2026-02-05 18:09:48,092 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). 2026-02-05 18:09:53,465 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). 2026-02-05 18:09:58,891 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). 2026-02-05 18:10:04,304 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). 2026-02-05 18:10:09,746 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). 2026-02-05 18:10:15,161 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). 2026-02-05 18:10:20,593 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). 2026-02-05 18:10:25,999 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). 2026-02-05 18:10:31,413 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). 2026-02-05 18:10:36,805 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). 2026-02-05 18:10:42,209 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). 2026-02-05 18:10:47,596 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). 2026-02-05 18:10:52,992 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). 2026-02-05 18:10:58,380 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). 2026-02-05 18:11:03,795 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). 2026-02-05 18:11:09,208 p=56020 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). 2026-02-05 18:11:14,622 p=56020 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** 2026-02-05 18:11:14,622 p=56020 u=1001930000 n=ansible ERROR| [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3 50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal) ^ column 3 2026-02-05 18:11:14,623 p=56020 u=1001930000 n=ansible INFO| fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-440 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.180324", "end": "2026-02-05 18:11:14.595350", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 18:11:14.415026", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} 2026-02-05 18:11:14,624 p=56020 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:11:14,624 p=56020 u=1001930000 n=ansible INFO| localhost : ok=20 changed=5 unreachable=0 failed=1 skipped=3 rescued=0 ignored=0 Run the command: oc get event -n test-oadp-440 2026/02/05 18:11:14 LAST SEEN TYPE REASON OBJECT MESSAGE 14m Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Normal Scheduled pod/cassandra-0 Successfully assigned test-oadp-440/cassandra-0 to ip-10-0-60-83.us-east-2.compute.internal 14m Normal SuccessfulAttachVolume pod/cassandra-0 AttachVolume.Attach succeeded for volume "pvc-3cf5679e-2ce5-432f-87a4-5e89db0f8e48" 14m Normal AddedInterface pod/cassandra-0 Add eth0 [10.129.2.216/23] from ovn-kubernetes 2m50s Normal Pulling pod/cassandra-0 Pulling image "quay.io/migqe/cassandra:multiarch" 14m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 503ms (503ms including waiting). Image size: 307783610 bytes. 11m Normal Created pod/cassandra-0 Created container: cassandra 11m Normal Started pod/cassandra-0 Started container cassandra 14m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 500ms (500ms including waiting). Image size: 307783610 bytes. 4m11s Warning BackOff pod/cassandra-0 Back-off restarting failed container cassandra in pod cassandra-0_test-oadp-440(9b078ea2-898d-4496-ad16-cf6acdb88303) 14m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 413ms (413ms including waiting). Image size: 307783610 bytes. 13m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 414ms (414ms including waiting). Image size: 307783610 bytes. 12m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 439ms (439ms including waiting). Image size: 307783610 bytes. 11m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 514ms (514ms including waiting). Image size: 307783610 bytes. 8m5s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 1.841s (1.841s including waiting). Image size: 307783610 bytes. 14m Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Normal Scheduled pod/cassandra-1 Successfully assigned test-oadp-440/cassandra-1 to ip-10-0-98-206.us-east-2.compute.internal 14m Normal SuccessfulAttachVolume pod/cassandra-1 AttachVolume.Attach succeeded for volume "pvc-bc124737-51f9-4639-ae86-601d7f252cd3" 14m Normal AddedInterface pod/cassandra-1 Add eth0 [10.131.0.93/23] from ovn-kubernetes 2m46s Normal Pulling pod/cassandra-1 Pulling image "quay.io/migqe/cassandra:multiarch" 14m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 459ms (459ms including waiting). Image size: 307783610 bytes. 10m Normal Created pod/cassandra-1 Created container: cassandra 10m Normal Started pod/cassandra-1 Started container cassandra 14m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 492ms (492ms including waiting). Image size: 307783610 bytes. 4m9s Warning BackOff pod/cassandra-1 Back-off restarting failed container cassandra in pod cassandra-1_test-oadp-440(221d1644-c8b5-49b6-92e0-df6a854c530e) 14m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 461ms (461ms including waiting). Image size: 307783610 bytes. 13m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 457ms (457ms including waiting). Image size: 307783610 bytes. 12m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 539ms (539ms including waiting). Image size: 307783610 bytes. 10m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 494ms (494ms including waiting). Image size: 307783610 bytes. 8m4s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 784ms (784ms including waiting). Image size: 307783610 bytes. 14m Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Normal Scheduled pod/cassandra-2 Successfully assigned test-oadp-440/cassandra-2 to ip-10-0-7-38.us-east-2.compute.internal 14m Normal SuccessfulAttachVolume pod/cassandra-2 AttachVolume.Attach succeeded for volume "pvc-88897a63-d0a9-4baa-b839-dc964f1ad0a1" 14m Normal AddedInterface pod/cassandra-2 Add eth0 [10.128.2.59/23] from ovn-kubernetes 2m42s Normal Pulling pod/cassandra-2 Pulling image "quay.io/migqe/cassandra:multiarch" 14m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 494ms (494ms including waiting). Image size: 307783610 bytes. 10m Normal Created pod/cassandra-2 Created container: cassandra 10m Normal Started pod/cassandra-2 Started container cassandra 14m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 418ms (418ms including waiting). Image size: 307783610 bytes. 3m54s Warning BackOff pod/cassandra-2 Back-off restarting failed container cassandra in pod cassandra-2_test-oadp-440(8d301cf7-a3b9-4fd3-af65-92a20a92c2cc) 13m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 513ms (513ms including waiting). Image size: 307783610 bytes. 13m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 478ms (478ms including waiting). Image size: 307783610 bytes. 12m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 709ms (709ms including waiting). Image size: 307783610 bytes. 10m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 515ms (515ms including waiting). Image size: 307783610 bytes. 7m48s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 646ms (646ms including waiting). Image size: 307783610 bytes. 14m Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-0 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 14m Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-0 External provisioner is provisioning volume for claim "test-oadp-440/cassandra-data-cassandra-0" 14m Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-0 Successfully provisioned volume pvc-3cf5679e-2ce5-432f-87a4-5e89db0f8e48 14m Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-1 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 14m Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-1 External provisioner is provisioning volume for claim "test-oadp-440/cassandra-data-cassandra-1" 14m Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-1 Successfully provisioned volume pvc-bc124737-51f9-4639-ae86-601d7f252cd3 14m Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-2 External provisioner is provisioning volume for claim "test-oadp-440/cassandra-data-cassandra-2" 14m Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-2 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 14m Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-2 Successfully provisioned volume pvc-88897a63-d0a9-4baa-b839-dc964f1ad0a1 14m Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-0 Pod cassandra-0 in StatefulSet cassandra success 14m Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-0 in StatefulSet cassandra successful 14m Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-1 Pod cassandra-1 in StatefulSet cassandra success 14m Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-1 in StatefulSet cassandra successful 14m Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-2 Pod cassandra-2 in StatefulSet cassandra success 14m Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-2 in StatefulSet cassandra successful 2026/02/05 18:11:14 Found server error pattern in ansible logs: '502' 2026/02/05 18:11:14 Detected server errors in ansible logs - treating as retryable 2026/02/05 18:11:14 ❌ Operation 'Deploy application ocp-cassandra' failed after 3 attempts. Final error: Error during command execution: ansible-playbook error: one or more host failed Command executed: /usr/local/bin/ansible-playbook --extra-vars {"admin_kubeconfig":"/home/jenkins/.kube/config","namespace":"test-oadp-440","non_admin_user":false,"use_role":"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra","user_kubeconfig":"/home/jenkins/.kube/config","with_deploy":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml exit status 2 [FAILED] in [It] - /alabama/cspi/test_common/backup_restore_app_case.go:49 @ 02/05/26 18:11:14.808 < Exit [It] [tc-id:OADP-440][interop] [Tier0] [vf:data-mover] Cassandra application @ 02/05/26 18:11:14.808 (14m48.983s) > Enter [JustAfterEach] TOP-LEVEL @ 02/05/26 18:11:14.808 2026/02/05 18:11:14 Using Must-gather image: registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 STEP: Get the failed spec name @ 02/05/26 18:11:14.809 2026/02/05 18:11:14 The failed spec name is: [datamover] DataMover: Backup/Restore stateful application with CSI [tc-id:OADP-440][interop] [Tier0] [vf:data-mover] Cassandra application STEP: Create a folder for all must-gather files if it doesn't exists already @ 02/05/26 18:11:14.809 STEP: Create a folder for the failed spec if it doesn't exists already @ 02/05/26 18:11:14.809 STEP: Run must-gather because the spec failed @ 02/05/26 18:11:14.809 2026/02/05 18:11:14 Log the present working directory path:- /alabama/cspi/e2e 2026/02/05 18:11:14 [adm must-gather --dest-dir /alabama/cspi/e2e/logs/It_datamover_DataMover_Backup_Restore_stateful_application_with_CSI_tc-id_OADP-440_interop_Tier0_vf_data-mover_Cassandra_application --image registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3] 2026/02/05 18:11:34 Log all the files present in /alabama/cspi/e2e/logs directory 2026/02/05 18:11:34 It_Backup_hooks_tests_Pre_exec_hook_tc-id_OADP-92_interop_smoke_Tier0_vf_backup-hooks_Cassandra_app_with_Restic 2026/02/05 18:11:34 It_datamover_DataMover_Backup_Restore_stateful_application_with_CSI_tc-id_OADP-440_interop_Tier0_vf_data-mover_Cassandra_application STEP: Find must-gather folder and rename it to a shorter more readable name @ 02/05/26 18:11:34.262 The folder logs/It_datamover_DataMover_Backup_Restore_stateful_application_with_CSI_tc-id_OADP-440_interop_Tier0_vf_data-mover_Cassandra_application/must-gather already exists, skipping renaming the folder Secret deletion flag: true Deleting cloud credentials secret cloud-credentials in namespace openshift-adp < Exit [JustAfterEach] TOP-LEVEL @ 02/05/26 18:11:34.279 (19.471s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 18:11:34.279 2026/02/05 18:11:34 Cleaning app 2026/02/05 18:11:34 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Remove namespace test-oadp-440] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=16  changed=5  unreachable=0 failed=0 skipped=22  rescued=0 ignored=0 2026/02/05 18:12:04 2026-02-05 18:11:35,996 p=57422 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:11:35,997 p=57422 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:11:36,335 p=57422 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:11:36,336 p=57422 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:11:36,678 p=57422 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:11:36,678 p=57422 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:11:36,996 p=57422 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:11:36,996 p=57422 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:11:37,015 p=57422 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:11:37,015 p=57422 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:11:37,015 p=57422 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:11:37,035 p=57422 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:11:37,035 p=57422 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:11:37,049 p=57422 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:11:37,050 p=57422 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:11:37,490 p=57422 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:11:37,490 p=57422 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:11:37,490 p=57422 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:11:37,490 p=57422 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:11:37,520 p=57422 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:11:37,520 p=57422 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:11:37,543 p=57422 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:11:37,543 p=57422 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:11:37,546 p=57422 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:11:38,155 p=57422 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:11:38,155 p=57422 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:12:04,342 p=57422 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Remove namespace test-oadp-440] *** 2026-02-05 18:12:04,343 p=57422 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:12:04,343 p=57422 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:12:04,344 p=57422 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:12:04,344 p=57422 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:12:04,344 p=57422 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:12:04,728 p=57422 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:12:04,728 p=57422 u=1001930000 n=ansible INFO| localhost : ok=16 changed=5 unreachable=0 failed=0 skipped=22 rescued=0 ignored=0 < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 18:12:04.782 (30.503s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 18:12:04.782 2026/02/05 18:12:04 Cleaning setup resources for the backup 2026/02/05 18:12:04 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 18:12:04 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2026/02/05 18:12:04 Deleting VolumeSnapshotClass 'example-snapclass' < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 18:12:04.807 (25ms) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 18:12:04.807 2026/02/05 18:12:04 Deleting DPA CR < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 18:12:04.819 (12ms) Attempt #2 Failed. Retrying ↺ @ 02/05/26 18:12:04.82 > Enter [BeforeEach] TOP-LEVEL @ 02/05/26 18:12:04.82 < Exit [BeforeEach] TOP-LEVEL @ 02/05/26 18:12:04.82 (0s) > Enter [BeforeEach] [datamover] DataMover: Backup/Restore stateful application with CSI @ 02/05/26 18:12:04.82 < Exit [BeforeEach] [datamover] DataMover: Backup/Restore stateful application with CSI @ 02/05/26 18:12:04.833 (14ms) > Enter [JustBeforeEach] TOP-LEVEL @ 02/05/26 18:12:04.833 < Exit [JustBeforeEach] TOP-LEVEL @ 02/05/26 18:12:04.833 (0s) > Enter [It] [tc-id:OADP-440][interop] [Tier0] [vf:data-mover] Cassandra application @ 02/05/26 18:12:04.833 2026/02/05 18:12:04 Delete all downloadrequest mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-1990a5c2-9b75-416a-bcba-21a4c3cf2841 mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-2e6c0092-e30c-4979-8418-dc082afb6b2d mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-616e1494-60f5-4a20-a06c-064d6d1602a0 mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-a1fcf134-0bd5-45aa-b146-07ed2f603cab mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-abf6d468-ac4c-494d-8816-357a8c85ed4b mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-b7090e22-4572-4c12-9b8e-87fb3a2b5620 mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-d469b53e-e84b-4ae5-a30c-632656099597 mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-e6209a04-7e1c-4928-a96b-a10c4a8c957e mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-f8da8d6d-db11-46d5-aec5-ae04e0ab0901 ocp-datavolume-5d53c5a8-02b2-11f1-a828-0a58ac1896e8-bbe5b34d-e173-4d13-9d8c-dd53990e145b ocp-datavolume-5d53c5a8-02b2-11f1-a828-0a58ac1896e8-c1b3cfb9-2728-412c-89e5-096f8f510a97 STEP: Create DPA CR @ 02/05/26 18:12:05.056 2026/02/05 18:12:05 native-datamover 2026/02/05 18:12:05 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "aa0531f1-7052-44c6-93ee-fdc44782c0ed", "resourceVersion": "171742", "generation": 1, "creationTimestamp": "2026-02-05T18:12:05Z", "managedFields": [ { "manager": "e2e.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T18:12:05Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:nodeAgent": { ".": {}, "f:enable": {}, "f:podConfig": { ".": {}, "f:resourceAllocations": {} }, "f:uploaderType": {} }, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false }, "nodeAgent": { "enable": true, "podConfig": { "resourceAllocations": {} }, "uploaderType": "kopia" } }, "features": null, "logFormat": "text" }, "status": {} } Delete all the backups that remained in the phase InProgress Deleting backup CRs in progress Deletion of backup CRs in progress completed Delete all the restores that remained in the phase InProgress Deleting restore CRs in progress Deletion of restore CRs in progress completed STEP: Verify DPA CR setup @ 02/05/26 18:12:05.086 2026/02/05 18:12:05 Waiting for velero pod to be running 2026/02/05 18:12:05 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete' 2026/02/05 18:12:05 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "aa0531f1-7052-44c6-93ee-fdc44782c0ed", "resourceVersion": "171742", "generation": 1, "creationTimestamp": "2026-02-05T18:12:05Z", "managedFields": [ { "manager": "e2e.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T18:12:05Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:nodeAgent": { ".": {}, "f:enable": {}, "f:podConfig": { ".": {}, "f:resourceAllocations": {} }, "f:uploaderType": {} }, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false }, "nodeAgent": { "enable": true, "podConfig": { "resourceAllocations": {} }, "uploaderType": "kopia" } }, "features": null, "logFormat": "text" }, "status": {} } 2026/02/05 18:12:10 DPA successfully reconciled STEP: Prepare backup resources, depending on the volumes backup type @ 02/05/26 18:12:10.105 2026/02/05 18:12:10 Snapclass 'example-snapclass' already exists, skip creating 2026/02/05 18:12:10 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 18:12:10 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2026/02/05 18:12:10 Checking for correct number of running NodeAgent pods... STEP: Installing application for case cassandra-e2e @ 02/05/26 18:12:10.144 2026/02/05 18:12:10 🔄 [Attempt 1/3] Executing operation: Deploy application ocp-cassandra 2026/02/05 18:12:10 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create namespace] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** changed: [localhost] [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** changed: [localhost] FAILED - RETRYING: [localhost]: Check pods status (30 retries left). FAILED - RETRYING: [localhost]: Check pods status (29 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** ok: [localhost] FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3  50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal)  ^ column 3  fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-440 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.179754", "end": "2026-02-05 18:15:26.625839", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 18:15:26.446085", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} PLAY RECAP ********************************************************************* localhost : ok=21  changed=8  unreachable=0 failed=1  skipped=2  rescued=0 ignored=0 2026/02/05 18:15:26 2026-02-05 18:12:11,890 p=57654 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:12:11,890 p=57654 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:12:12,216 p=57654 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:12:12,216 p=57654 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:12:12,540 p=57654 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:12:12,540 p=57654 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:12:12,877 p=57654 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:12:12,877 p=57654 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:12:12,895 p=57654 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:12:12,895 p=57654 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:12:12,895 p=57654 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:12:12,916 p=57654 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:12:12,916 p=57654 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:12:12,932 p=57654 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:12:12,932 p=57654 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:12:13,355 p=57654 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:12:13,355 p=57654 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:12:13,356 p=57654 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:12:13,356 p=57654 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:12:13,388 p=57654 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:12:13,388 p=57654 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:12:13,411 p=57654 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:12:13,411 p=57654 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:12:13,414 p=57654 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:12:14,023 p=57654 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:12:14,023 p=57654 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:12:15,115 p=57654 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** 2026-02-05 18:12:15,115 p=57654 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:12:15,115 p=57654 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:12:15,115 p=57654 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:12:15,116 p=57654 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:12:15,116 p=57654 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:12:15,573 p=57654 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create namespace] *** 2026-02-05 18:12:15,574 p=57654 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:12:15,957 p=57654 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** 2026-02-05 18:12:15,957 p=57654 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:12:17,172 p=57654 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** 2026-02-05 18:12:17,173 p=57654 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:12:18,223 p=57654 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** 2026-02-05 18:12:18,224 p=57654 u=1001930000 n=ansible WARNING| [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" 2026-02-05 18:12:18,225 p=57654 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. 2026-02-05 18:12:18,225 p=57654 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:12:19,237 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (30 retries left). 2026-02-05 18:12:25,146 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (29 retries left). 2026-02-05 18:12:31,088 p=57654 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** 2026-02-05 18:12:31,089 p=57654 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:12:34,236 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). 2026-02-05 18:12:41,331 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). 2026-02-05 18:12:46,750 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). 2026-02-05 18:12:52,151 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). 2026-02-05 18:13:02,040 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). 2026-02-05 18:13:07,459 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). 2026-02-05 18:13:12,869 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). 2026-02-05 18:13:18,281 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). 2026-02-05 18:13:23,752 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). 2026-02-05 18:13:29,142 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). 2026-02-05 18:13:37,129 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). 2026-02-05 18:13:42,537 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). 2026-02-05 18:13:47,923 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). 2026-02-05 18:13:53,330 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). 2026-02-05 18:13:58,725 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). 2026-02-05 18:14:04,107 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). 2026-02-05 18:14:09,485 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). 2026-02-05 18:14:14,865 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). 2026-02-05 18:14:20,273 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). 2026-02-05 18:14:25,693 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). 2026-02-05 18:14:31,123 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). 2026-02-05 18:14:37,830 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). 2026-02-05 18:14:43,280 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). 2026-02-05 18:14:48,720 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). 2026-02-05 18:14:54,146 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). 2026-02-05 18:14:59,548 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). 2026-02-05 18:15:04,957 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). 2026-02-05 18:15:10,392 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). 2026-02-05 18:15:15,845 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). 2026-02-05 18:15:21,251 p=57654 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). 2026-02-05 18:15:26,654 p=57654 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** 2026-02-05 18:15:26,654 p=57654 u=1001930000 n=ansible ERROR| [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3 50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal) ^ column 3 2026-02-05 18:15:26,655 p=57654 u=1001930000 n=ansible INFO| fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-440 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.179754", "end": "2026-02-05 18:15:26.625839", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 18:15:26.446085", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} 2026-02-05 18:15:26,656 p=57654 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:15:26,656 p=57654 u=1001930000 n=ansible INFO| localhost : ok=21 changed=8 unreachable=0 failed=1 skipped=2 rescued=0 ignored=0 Run the command: oc get event -n test-oadp-440 2026/02/05 18:15:26 LAST SEEN TYPE REASON OBJECT MESSAGE 3m8s Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 3m8s Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 3m8s Normal Scheduled pod/cassandra-0 Successfully assigned test-oadp-440/cassandra-0 to ip-10-0-60-83.us-east-2.compute.internal 3m7s Normal SuccessfulAttachVolume pod/cassandra-0 AttachVolume.Attach succeeded for volume "pvc-88076dc7-6deb-4144-b87a-178af29fabdc" 2m59s Normal AddedInterface pod/cassandra-0 Add eth0 [10.129.2.235/23] from ovn-kubernetes 56s Normal Pulling pod/cassandra-0 Pulling image "quay.io/migqe/cassandra:multiarch" 2m58s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 594ms (594ms including waiting). Image size: 307783610 bytes. 55s Normal Created pod/cassandra-0 Created container: cassandra 55s Normal Started pod/cassandra-0 Started container cassandra 2m51s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 683ms (683ms including waiting). Image size: 307783610 bytes. 5s Warning BackOff pod/cassandra-0 Back-off restarting failed container cassandra in pod cassandra-0_test-oadp-440(7ab02d65-4ae6-4993-ad03-1badeb5be84a) 2m31s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 488ms (488ms including waiting). Image size: 307783610 bytes. 116s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 638ms (638ms including waiting). Image size: 307783610 bytes. 55s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 717ms (717ms including waiting). Image size: 307783610 bytes. 2m57s Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 2m57s Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 2m57s Normal Scheduled pod/cassandra-1 Successfully assigned test-oadp-440/cassandra-1 to ip-10-0-98-206.us-east-2.compute.internal 2m57s Normal SuccessfulAttachVolume pod/cassandra-1 AttachVolume.Attach succeeded for volume "pvc-babe21b9-674c-49c9-a6bc-5bd2f8d83af6" 2m54s Normal AddedInterface pod/cassandra-1 Add eth0 [10.131.0.96/23] from ovn-kubernetes 55s Normal Pulling pod/cassandra-1 Pulling image "quay.io/migqe/cassandra:multiarch" 2m53s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 659ms (659ms including waiting). Image size: 307783610 bytes. 54s Normal Created pod/cassandra-1 Created container: cassandra 54s Normal Started pod/cassandra-1 Started container cassandra 2m45s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 369ms (369ms including waiting). Image size: 307783610 bytes. 7s Warning BackOff pod/cassandra-1 Back-off restarting failed container cassandra in pod cassandra-1_test-oadp-440(58efa233-8462-4f94-84fd-a9aeae55ba6c) 2m25s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 623ms (623ms including waiting). Image size: 307783610 bytes. 115s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 445ms (445ms including waiting). Image size: 307783610 bytes. 55s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 458ms (458ms including waiting). Image size: 307783610 bytes. 2m53s Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 2m52s Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 2m52s Normal Scheduled pod/cassandra-2 Successfully assigned test-oadp-440/cassandra-2 to ip-10-0-7-38.us-east-2.compute.internal 2m52s Normal SuccessfulAttachVolume pod/cassandra-2 AttachVolume.Attach succeeded for volume "pvc-11463b30-3131-4637-a7d6-da416b4f3567" 2m42s Normal AddedInterface pod/cassandra-2 Add eth0 [10.128.2.61/23] from ovn-kubernetes 58s Normal Pulling pod/cassandra-2 Pulling image "quay.io/migqe/cassandra:multiarch" 2m41s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 567ms (567ms including waiting). Image size: 307783610 bytes. 58s Normal Created pod/cassandra-2 Created container: cassandra 58s Normal Started pod/cassandra-2 Started container cassandra 2m36s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 556ms (556ms including waiting). Image size: 307783610 bytes. 10s Warning BackOff pod/cassandra-2 Back-off restarting failed container cassandra in pod cassandra-2_test-oadp-440(716565f7-3ffd-4671-ae72-8bc643c9fb0f) 2m16s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 446ms (446ms including waiting). Image size: 307783610 bytes. 108s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 417ms (417ms including waiting). Image size: 307783610 bytes. 58s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 733ms (733ms including waiting). Image size: 307783610 bytes. 3m8s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-0 External provisioner is provisioning volume for claim "test-oadp-440/cassandra-data-cassandra-0" 3m8s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-0 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 3m8s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-0 Successfully provisioned volume pvc-88076dc7-6deb-4144-b87a-178af29fabdc 2m58s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-1 External provisioner is provisioning volume for claim "test-oadp-440/cassandra-data-cassandra-1" 2m58s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-1 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 2m57s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-1 Successfully provisioned volume pvc-babe21b9-674c-49c9-a6bc-5bd2f8d83af6 2m53s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-2 External provisioner is provisioning volume for claim "test-oadp-440/cassandra-data-cassandra-2" 2m53s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-2 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 2m52s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-2 Successfully provisioned volume pvc-11463b30-3131-4637-a7d6-da416b4f3567 3m8s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-0 Pod cassandra-0 in StatefulSet cassandra success 3m8s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-0 in StatefulSet cassandra successful 2m58s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-1 Pod cassandra-1 in StatefulSet cassandra success 2m58s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-1 in StatefulSet cassandra successful 2m53s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-2 Pod cassandra-2 in StatefulSet cassandra success 2m53s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-2 in StatefulSet cassandra successful 2026/02/05 18:15:26 Found server error pattern in ansible logs: '502' 2026/02/05 18:15:26 Detected server errors in ansible logs - treating as retryable 2026/02/05 18:15:26 ⚠️ Operation 'Deploy application ocp-cassandra' failed with retryable server error (attempt 1/3): Error during command execution: ansible-playbook error: one or more host failed Command executed: /usr/local/bin/ansible-playbook --extra-vars {"admin_kubeconfig":"/home/jenkins/.kube/config","namespace":"test-oadp-440","non_admin_user":false,"use_role":"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra","user_kubeconfig":"/home/jenkins/.kube/config","with_deploy":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml exit status 2 2026/02/05 18:15:26 🕐 Waiting 1m0s before retry... 2026/02/05 18:16:26 🔄 [Attempt 2/3] Executing operation: Deploy application ocp-cassandra 2026/02/05 18:16:26 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** ok: [localhost] [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** ok: [localhost] FAILED - RETRYING: [localhost]: Check pods status (30 retries left). FAILED - RETRYING: [localhost]: Check pods status (29 retries left). FAILED - RETRYING: [localhost]: Check pods status (28 retries left). FAILED - RETRYING: [localhost]: Check pods status (27 retries left). FAILED - RETRYING: [localhost]: Check pods status (26 retries left). FAILED - RETRYING: [localhost]: Check pods status (25 retries left). FAILED - RETRYING: [localhost]: Check pods status (24 retries left). FAILED - RETRYING: [localhost]: Check pods status (23 retries left). FAILED - RETRYING: [localhost]: Check pods status (22 retries left). FAILED - RETRYING: [localhost]: Check pods status (21 retries left). FAILED - RETRYING: [localhost]: Check pods status (20 retries left). FAILED - RETRYING: [localhost]: Check pods status (19 retries left). FAILED - RETRYING: [localhost]: Check pods status (18 retries left). FAILED - RETRYING: [localhost]: Check pods status (17 retries left). FAILED - RETRYING: [localhost]: Check pods status (16 retries left). FAILED - RETRYING: [localhost]: Check pods status (15 retries left). FAILED - RETRYING: [localhost]: Check pods status (14 retries left). FAILED - RETRYING: [localhost]: Check pods status (13 retries left). FAILED - RETRYING: [localhost]: Check pods status (12 retries left). FAILED - RETRYING: [localhost]: Check pods status (11 retries left). FAILED - RETRYING: [localhost]: Check pods status (10 retries left). FAILED - RETRYING: [localhost]: Check pods status (9 retries left). FAILED - RETRYING: [localhost]: Check pods status (8 retries left). FAILED - RETRYING: [localhost]: Check pods status (7 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** ok: [localhost] FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3  50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal)  ^ column 3  fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-440 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.169876", "end": "2026-02-05 18:21:42.387150", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 18:21:42.217274", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} PLAY RECAP ********************************************************************* localhost : ok=20  changed=5  unreachable=0 failed=1  skipped=3  rescued=0 ignored=0 2026/02/05 18:21:42 2026-02-05 18:16:28,635 p=59032 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:16:28,636 p=59032 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:16:28,952 p=59032 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:16:28,952 p=59032 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:16:29,271 p=59032 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:16:29,271 p=59032 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:16:29,581 p=59032 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:16:29,581 p=59032 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:16:29,599 p=59032 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:16:29,600 p=59032 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:16:29,600 p=59032 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:16:29,621 p=59032 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:16:29,621 p=59032 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:16:29,636 p=59032 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:16:29,637 p=59032 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:16:30,079 p=59032 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:16:30,080 p=59032 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:16:30,080 p=59032 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:16:30,080 p=59032 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:16:30,109 p=59032 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:16:30,109 p=59032 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:16:30,133 p=59032 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:16:30,133 p=59032 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:16:30,136 p=59032 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:16:30,753 p=59032 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:16:30,753 p=59032 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:16:31,889 p=59032 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** 2026-02-05 18:16:31,890 p=59032 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:16:31,890 p=59032 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:16:31,891 p=59032 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:16:31,891 p=59032 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:16:31,891 p=59032 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:16:32,271 p=59032 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** 2026-02-05 18:16:32,272 p=59032 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:16:33,447 p=59032 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** 2026-02-05 18:16:33,448 p=59032 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:16:34,473 p=59032 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** 2026-02-05 18:16:34,473 p=59032 u=1001930000 n=ansible WARNING| [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" 2026-02-05 18:16:34,474 p=59032 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. 2026-02-05 18:16:34,474 p=59032 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:16:35,451 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (30 retries left). 2026-02-05 18:16:41,340 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (29 retries left). 2026-02-05 18:16:47,242 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (28 retries left). 2026-02-05 18:16:53,148 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (27 retries left). 2026-02-05 18:16:59,373 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (26 retries left). 2026-02-05 18:17:05,518 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (25 retries left). 2026-02-05 18:17:11,374 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (24 retries left). 2026-02-05 18:17:17,271 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (23 retries left). 2026-02-05 18:17:23,188 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (22 retries left). 2026-02-05 18:17:29,132 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (21 retries left). 2026-02-05 18:17:35,011 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (20 retries left). 2026-02-05 18:17:40,901 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (19 retries left). 2026-02-05 18:17:46,805 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (18 retries left). 2026-02-05 18:17:52,711 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (17 retries left). 2026-02-05 18:17:58,587 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (16 retries left). 2026-02-05 18:18:04,503 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (15 retries left). 2026-02-05 18:18:10,415 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (14 retries left). 2026-02-05 18:18:16,310 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (13 retries left). 2026-02-05 18:18:22,197 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (12 retries left). 2026-02-05 18:18:28,088 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (11 retries left). 2026-02-05 18:18:33,974 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (10 retries left). 2026-02-05 18:18:39,884 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (9 retries left). 2026-02-05 18:18:45,809 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (8 retries left). 2026-02-05 18:18:51,752 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (7 retries left). 2026-02-05 18:18:57,681 p=59032 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** 2026-02-05 18:18:57,682 p=59032 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:19:00,432 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). 2026-02-05 18:19:05,816 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). 2026-02-05 18:19:11,232 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). 2026-02-05 18:19:16,632 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). 2026-02-05 18:19:22,025 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). 2026-02-05 18:19:27,420 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). 2026-02-05 18:19:32,803 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). 2026-02-05 18:19:38,213 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). 2026-02-05 18:19:43,607 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). 2026-02-05 18:19:48,995 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). 2026-02-05 18:19:54,404 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). 2026-02-05 18:19:59,809 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). 2026-02-05 18:20:05,205 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). 2026-02-05 18:20:10,598 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). 2026-02-05 18:20:15,984 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). 2026-02-05 18:20:21,388 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). 2026-02-05 18:20:26,789 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). 2026-02-05 18:20:32,194 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). 2026-02-05 18:20:37,616 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). 2026-02-05 18:20:43,013 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). 2026-02-05 18:20:48,395 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). 2026-02-05 18:20:53,807 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). 2026-02-05 18:20:59,227 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). 2026-02-05 18:21:04,646 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). 2026-02-05 18:21:10,043 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). 2026-02-05 18:21:15,450 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). 2026-02-05 18:21:20,858 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). 2026-02-05 18:21:26,240 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). 2026-02-05 18:21:31,628 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). 2026-02-05 18:21:37,024 p=59032 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). 2026-02-05 18:21:42,414 p=59032 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** 2026-02-05 18:21:42,415 p=59032 u=1001930000 n=ansible ERROR| [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3 50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal) ^ column 3 2026-02-05 18:21:42,415 p=59032 u=1001930000 n=ansible INFO| fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-440 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.169876", "end": "2026-02-05 18:21:42.387150", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 18:21:42.217274", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} 2026-02-05 18:21:42,416 p=59032 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:21:42,417 p=59032 u=1001930000 n=ansible INFO| localhost : ok=20 changed=5 unreachable=0 failed=1 skipped=3 rescued=0 ignored=0 Run the command: oc get event -n test-oadp-440 2026/02/05 18:21:42 LAST SEEN TYPE REASON OBJECT MESSAGE 9m24s Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m24s Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m24s Normal Scheduled pod/cassandra-0 Successfully assigned test-oadp-440/cassandra-0 to ip-10-0-60-83.us-east-2.compute.internal 9m23s Normal SuccessfulAttachVolume pod/cassandra-0 AttachVolume.Attach succeeded for volume "pvc-88076dc7-6deb-4144-b87a-178af29fabdc" 9m15s Normal AddedInterface pod/cassandra-0 Add eth0 [10.129.2.235/23] from ovn-kubernetes 2m49s Normal Pulling pod/cassandra-0 Pulling image "quay.io/migqe/cassandra:multiarch" 9m14s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 594ms (594ms including waiting). Image size: 307783610 bytes. 5m38s Normal Created pod/cassandra-0 Created container: cassandra 5m38s Normal Started pod/cassandra-0 Started container cassandra 9m7s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 683ms (683ms including waiting). Image size: 307783610 bytes. 2m42s Warning BackOff pod/cassandra-0 Back-off restarting failed container cassandra in pod cassandra-0_test-oadp-440(7ab02d65-4ae6-4993-ad03-1badeb5be84a) 8m47s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 488ms (488ms including waiting). Image size: 307783610 bytes. 8m12s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 638ms (638ms including waiting). Image size: 307783610 bytes. 7m11s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 717ms (717ms including waiting). Image size: 307783610 bytes. 5m38s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 449ms (449ms including waiting). Image size: 307783610 bytes. 2m49s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 456ms (456ms including waiting). Image size: 307783610 bytes. 9m13s Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m13s Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m13s Normal Scheduled pod/cassandra-1 Successfully assigned test-oadp-440/cassandra-1 to ip-10-0-98-206.us-east-2.compute.internal 9m13s Normal SuccessfulAttachVolume pod/cassandra-1 AttachVolume.Attach succeeded for volume "pvc-babe21b9-674c-49c9-a6bc-5bd2f8d83af6" 9m10s Normal AddedInterface pod/cassandra-1 Add eth0 [10.131.0.96/23] from ovn-kubernetes 2m51s Normal Pulling pod/cassandra-1 Pulling image "quay.io/migqe/cassandra:multiarch" 9m9s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 659ms (659ms including waiting). Image size: 307783610 bytes. 5m42s Normal Created pod/cassandra-1 Created container: cassandra 5m42s Normal Started pod/cassandra-1 Started container cassandra 9m1s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 369ms (369ms including waiting). Image size: 307783610 bytes. 3m3s Warning BackOff pod/cassandra-1 Back-off restarting failed container cassandra in pod cassandra-1_test-oadp-440(58efa233-8462-4f94-84fd-a9aeae55ba6c) 8m41s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 623ms (623ms including waiting). Image size: 307783610 bytes. 8m11s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 445ms (445ms including waiting). Image size: 307783610 bytes. 7m11s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 458ms (458ms including waiting). Image size: 307783610 bytes. 5m42s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 664ms (664ms including waiting). Image size: 307783610 bytes. 2m50s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 557ms (557ms including waiting). Image size: 307783610 bytes. 9m8s Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m8s Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 9m8s Normal Scheduled pod/cassandra-2 Successfully assigned test-oadp-440/cassandra-2 to ip-10-0-7-38.us-east-2.compute.internal 9m8s Normal SuccessfulAttachVolume pod/cassandra-2 AttachVolume.Attach succeeded for volume "pvc-11463b30-3131-4637-a7d6-da416b4f3567" 8m58s Normal AddedInterface pod/cassandra-2 Add eth0 [10.128.2.61/23] from ovn-kubernetes 2m45s Normal Pulling pod/cassandra-2 Pulling image "quay.io/migqe/cassandra:multiarch" 8m57s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 567ms (567ms including waiting). Image size: 307783610 bytes. 5m34s Normal Created pod/cassandra-2 Created container: cassandra 5m34s Normal Started pod/cassandra-2 Started container cassandra 8m52s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 556ms (556ms including waiting). Image size: 307783610 bytes. 2m40s Warning BackOff pod/cassandra-2 Back-off restarting failed container cassandra in pod cassandra-2_test-oadp-440(716565f7-3ffd-4671-ae72-8bc643c9fb0f) 8m32s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 446ms (446ms including waiting). Image size: 307783610 bytes. 8m4s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 417ms (417ms including waiting). Image size: 307783610 bytes. 7m14s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 733ms (733ms including waiting). Image size: 307783610 bytes. 5m34s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 569ms (569ms including waiting). Image size: 307783610 bytes. 2m45s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 490ms (490ms including waiting). Image size: 307783610 bytes. 9m24s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-0 External provisioner is provisioning volume for claim "test-oadp-440/cassandra-data-cassandra-0" 9m24s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-0 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 9m24s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-0 Successfully provisioned volume pvc-88076dc7-6deb-4144-b87a-178af29fabdc 9m14s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-1 External provisioner is provisioning volume for claim "test-oadp-440/cassandra-data-cassandra-1" 9m14s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-1 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 9m13s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-1 Successfully provisioned volume pvc-babe21b9-674c-49c9-a6bc-5bd2f8d83af6 9m9s Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-2 External provisioner is provisioning volume for claim "test-oadp-440/cassandra-data-cassandra-2" 9m9s Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-2 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 9m8s Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-2 Successfully provisioned volume pvc-11463b30-3131-4637-a7d6-da416b4f3567 9m24s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-0 Pod cassandra-0 in StatefulSet cassandra success 9m24s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-0 in StatefulSet cassandra successful 9m14s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-1 Pod cassandra-1 in StatefulSet cassandra success 9m14s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-1 in StatefulSet cassandra successful 9m9s Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-2 Pod cassandra-2 in StatefulSet cassandra success 9m9s Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-2 in StatefulSet cassandra successful 2026/02/05 18:21:42 Found server error pattern in ansible logs: '503' 2026/02/05 18:21:42 Detected server errors in ansible logs - treating as retryable 2026/02/05 18:21:42 ⚠️ Operation 'Deploy application ocp-cassandra' failed with retryable server error (attempt 2/3): Error during command execution: ansible-playbook error: one or more host failed Command executed: /usr/local/bin/ansible-playbook --extra-vars {"admin_kubeconfig":"/home/jenkins/.kube/config","namespace":"test-oadp-440","non_admin_user":false,"use_role":"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra","user_kubeconfig":"/home/jenkins/.kube/config","with_deploy":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml exit status 2 2026/02/05 18:21:42 🕐 Waiting 2m0s before retry... 2026/02/05 18:23:42 🔄 [Attempt 3/3] Executing operation: Deploy application ocp-cassandra 2026/02/05 18:23:42 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** ok: [localhost] [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** ok: [localhost] FAILED - RETRYING: [localhost]: Check pods status (30 retries left). FAILED - RETRYING: [localhost]: Check pods status (29 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** ok: [localhost] FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3  50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal)  ^ column 3  fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-440 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.173532", "end": "2026-02-05 18:26:56.098402", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 18:26:55.924870", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} PLAY RECAP ********************************************************************* localhost : ok=20  changed=5  unreachable=0 failed=1  skipped=3  rescued=0 ignored=0 2026/02/05 18:26:56 2026-02-05 18:23:44,406 p=60662 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:23:44,406 p=60662 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:23:44,763 p=60662 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:23:44,763 p=60662 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:23:45,120 p=60662 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:23:45,121 p=60662 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:23:45,477 p=60662 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:23:45,477 p=60662 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:23:45,497 p=60662 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:23:45,498 p=60662 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:23:45,498 p=60662 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:23:45,519 p=60662 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:23:45,519 p=60662 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:23:45,536 p=60662 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:23:45,536 p=60662 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:23:46,004 p=60662 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:23:46,005 p=60662 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:23:46,005 p=60662 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:23:46,006 p=60662 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:23:46,037 p=60662 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:23:46,038 p=60662 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:23:46,061 p=60662 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:23:46,062 p=60662 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:23:46,065 p=60662 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:23:46,746 p=60662 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:23:46,746 p=60662 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:23:47,995 p=60662 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check namespace] *** 2026-02-05 18:23:47,996 p=60662 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:23:47,996 p=60662 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:23:47,996 p=60662 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:23:47,996 p=60662 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:23:47,997 p=60662 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:23:50,502 p=60662 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Add scc privileged to service account] *** 2026-02-05 18:23:50,502 p=60662 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:23:51,786 p=60662 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a service object required to provide network identity] *** 2026-02-05 18:23:51,787 p=60662 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:23:52,906 p=60662 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Create a statefulset with the existing yaml] *** 2026-02-05 18:23:52,906 p=60662 u=1001930000 n=ansible WARNING| [WARNING]: unknown field "spec.volumeClaimTemplates[0].labels" 2026-02-05 18:23:52,907 p=60662 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Passing `warnings` to `exit_json` or `fail_json` is deprecated. This feature will be removed from ansible-core version 2.23. Use `AnsibleModule.warn` instead. 2026-02-05 18:23:52,907 p=60662 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:23:54,094 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (30 retries left). 2026-02-05 18:24:00,106 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pods status (29 retries left). 2026-02-05 18:24:06,079 p=60662 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Check pods status] *** 2026-02-05 18:24:06,080 p=60662 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:24:11,637 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (30 retries left). 2026-02-05 18:24:17,048 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (29 retries left). 2026-02-05 18:24:22,465 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (28 retries left). 2026-02-05 18:24:27,916 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (27 retries left). 2026-02-05 18:24:33,400 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (26 retries left). 2026-02-05 18:24:38,855 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (25 retries left). 2026-02-05 18:24:44,338 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (24 retries left). 2026-02-05 18:24:49,842 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (23 retries left). 2026-02-05 18:24:55,261 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (22 retries left). 2026-02-05 18:25:00,661 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (21 retries left). 2026-02-05 18:25:06,112 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (20 retries left). 2026-02-05 18:25:11,565 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (19 retries left). 2026-02-05 18:25:17,014 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (18 retries left). 2026-02-05 18:25:22,480 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (17 retries left). 2026-02-05 18:25:27,923 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (16 retries left). 2026-02-05 18:25:33,323 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (15 retries left). 2026-02-05 18:25:38,775 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (14 retries left). 2026-02-05 18:25:44,200 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (13 retries left). 2026-02-05 18:25:49,633 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (12 retries left). 2026-02-05 18:25:55,184 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (11 retries left). 2026-02-05 18:26:00,582 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (10 retries left). 2026-02-05 18:26:06,030 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (9 retries left). 2026-02-05 18:26:11,771 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (8 retries left). 2026-02-05 18:26:17,475 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (7 retries left). 2026-02-05 18:26:23,248 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (6 retries left). 2026-02-05 18:26:28,973 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (5 retries left). 2026-02-05 18:26:34,412 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (4 retries left). 2026-02-05 18:26:39,891 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (3 retries left). 2026-02-05 18:26:45,296 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (2 retries left). 2026-02-05 18:26:50,711 p=60662 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until all cassandra node are ready (Status=Up and State=Normal) (1 retries left). 2026-02-05 18:26:56,125 p=60662 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Wait until all cassandra node are ready (Status=Up and State=Normal)] *** 2026-02-05 18:26:56,126 p=60662 u=1001930000 n=ansible ERROR| [ERROR]: Task failed: Module failed: non-zero return code Origin: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra/tasks/deploy.yml:52:3 50 retries: 30 51 52 - name: Wait until all cassandra node are ready (Status=Up and State=Normal) ^ column 3 2026-02-05 18:26:56,126 p=60662 u=1001930000 n=ansible INFO| fatal: [localhost]: FAILED! => {"attempts": 30, "changed": true, "cmd": "oc --insecure-skip-tls-verify --server https://api.ci-op-988mlksm-2c502.cspilp.interop.ccitredhat.com:6443 --token sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U -n test-oadp-440 exec -it cassandra-0 -- nodetool status", "delta": "0:00:00.173532", "end": "2026-02-05 18:26:56.098402", "msg": "non-zero return code", "rc": 1, "start": "2026-02-05 18:26:55.924870", "stderr": "Unable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cassandra\")", "stderr_lines": ["Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cassandra\")"], "stdout": "", "stdout_lines": []} 2026-02-05 18:26:56,127 p=60662 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:26:56,127 p=60662 u=1001930000 n=ansible INFO| localhost : ok=20 changed=5 unreachable=0 failed=1 skipped=3 rescued=0 ignored=0 Run the command: oc get event -n test-oadp-440 2026/02/05 18:26:56 LAST SEEN TYPE REASON OBJECT MESSAGE 14m Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Warning FailedScheduling pod/cassandra-0 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Normal Scheduled pod/cassandra-0 Successfully assigned test-oadp-440/cassandra-0 to ip-10-0-60-83.us-east-2.compute.internal 14m Normal SuccessfulAttachVolume pod/cassandra-0 AttachVolume.Attach succeeded for volume "pvc-88076dc7-6deb-4144-b87a-178af29fabdc" 14m Normal AddedInterface pod/cassandra-0 Add eth0 [10.129.2.235/23] from ovn-kubernetes 2m52s Normal Pulling pod/cassandra-0 Pulling image "quay.io/migqe/cassandra:multiarch" 14m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 594ms (594ms including waiting). Image size: 307783610 bytes. 10m Normal Created pod/cassandra-0 Created container: cassandra 10m Normal Started pod/cassandra-0 Started container cassandra 14m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 683ms (683ms including waiting). Image size: 307783610 bytes. 4m10s Warning BackOff pod/cassandra-0 Back-off restarting failed container cassandra in pod cassandra-0_test-oadp-440(7ab02d65-4ae6-4993-ad03-1badeb5be84a) 14m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 488ms (488ms including waiting). Image size: 307783610 bytes. 13m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 638ms (638ms including waiting). Image size: 307783610 bytes. 12m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 717ms (717ms including waiting). Image size: 307783610 bytes. 10m Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 449ms (449ms including waiting). Image size: 307783610 bytes. 8m3s Normal Pulled pod/cassandra-0 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 456ms (456ms including waiting). Image size: 307783610 bytes. 14m Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Warning FailedScheduling pod/cassandra-1 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Normal Scheduled pod/cassandra-1 Successfully assigned test-oadp-440/cassandra-1 to ip-10-0-98-206.us-east-2.compute.internal 14m Normal SuccessfulAttachVolume pod/cassandra-1 AttachVolume.Attach succeeded for volume "pvc-babe21b9-674c-49c9-a6bc-5bd2f8d83af6" 14m Normal AddedInterface pod/cassandra-1 Add eth0 [10.131.0.96/23] from ovn-kubernetes 2m46s Normal Pulling pod/cassandra-1 Pulling image "quay.io/migqe/cassandra:multiarch" 14m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 659ms (659ms including waiting). Image size: 307783610 bytes. 10m Normal Created pod/cassandra-1 Created container: cassandra 10m Normal Started pod/cassandra-1 Started container cassandra 14m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 369ms (369ms including waiting). Image size: 307783610 bytes. 4m2s Warning BackOff pod/cassandra-1 Back-off restarting failed container cassandra in pod cassandra-1_test-oadp-440(58efa233-8462-4f94-84fd-a9aeae55ba6c) 13m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 623ms (623ms including waiting). Image size: 307783610 bytes. 13m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 445ms (445ms including waiting). Image size: 307783610 bytes. 12m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 458ms (458ms including waiting). Image size: 307783610 bytes. 10m Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 664ms (664ms including waiting). Image size: 307783610 bytes. 8m4s Normal Pulled pod/cassandra-1 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 557ms (557ms including waiting). Image size: 307783610 bytes. 14m Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Warning FailedScheduling pod/cassandra-2 0/6 nodes are available: pod has unbound immediate PersistentVolumeClaims. not found 14m Normal Scheduled pod/cassandra-2 Successfully assigned test-oadp-440/cassandra-2 to ip-10-0-7-38.us-east-2.compute.internal 14m Normal SuccessfulAttachVolume pod/cassandra-2 AttachVolume.Attach succeeded for volume "pvc-11463b30-3131-4637-a7d6-da416b4f3567" 14m Normal AddedInterface pod/cassandra-2 Add eth0 [10.128.2.61/23] from ovn-kubernetes 2m44s Normal Pulling pod/cassandra-2 Pulling image "quay.io/migqe/cassandra:multiarch" 14m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 567ms (567ms including waiting). Image size: 307783610 bytes. 10m Normal Created pod/cassandra-2 Created container: cassandra 10m Normal Started pod/cassandra-2 Started container cassandra 14m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 556ms (556ms including waiting). Image size: 307783610 bytes. 3m50s Warning BackOff pod/cassandra-2 Back-off restarting failed container cassandra in pod cassandra-2_test-oadp-440(716565f7-3ffd-4671-ae72-8bc643c9fb0f) 13m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 446ms (446ms including waiting). Image size: 307783610 bytes. 13m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 417ms (417ms including waiting). Image size: 307783610 bytes. 12m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 733ms (733ms including waiting). Image size: 307783610 bytes. 10m Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 569ms (569ms including waiting). Image size: 307783610 bytes. 7m59s Normal Pulled pod/cassandra-2 Successfully pulled image "quay.io/migqe/cassandra:multiarch" in 490ms (490ms including waiting). Image size: 307783610 bytes. 14m Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-0 External provisioner is provisioning volume for claim "test-oadp-440/cassandra-data-cassandra-0" 14m Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-0 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 14m Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-0 Successfully provisioned volume pvc-88076dc7-6deb-4144-b87a-178af29fabdc 14m Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-1 External provisioner is provisioning volume for claim "test-oadp-440/cassandra-data-cassandra-1" 14m Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-1 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 14m Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-1 Successfully provisioned volume pvc-babe21b9-674c-49c9-a6bc-5bd2f8d83af6 14m Normal Provisioning persistentvolumeclaim/cassandra-data-cassandra-2 External provisioner is provisioning volume for claim "test-oadp-440/cassandra-data-cassandra-2" 14m Normal ExternalProvisioning persistentvolumeclaim/cassandra-data-cassandra-2 Waiting for a volume to be created either by the external provisioner 'openshift-storage.rbd.csi.ceph.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. 14m Normal ProvisioningSucceeded persistentvolumeclaim/cassandra-data-cassandra-2 Successfully provisioned volume pvc-11463b30-3131-4637-a7d6-da416b4f3567 14m Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-0 Pod cassandra-0 in StatefulSet cassandra success 14m Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-0 in StatefulSet cassandra successful 14m Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-1 Pod cassandra-1 in StatefulSet cassandra success 14m Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-1 in StatefulSet cassandra successful 14m Normal SuccessfulCreate statefulset/cassandra create Claim cassandra-data-cassandra-2 Pod cassandra-2 in StatefulSet cassandra success 14m Normal SuccessfulCreate statefulset/cassandra create Pod cassandra-2 in StatefulSet cassandra successful 2026/02/05 18:26:56 Found server error pattern in ansible logs: '502' 2026/02/05 18:26:56 Detected server errors in ansible logs - treating as retryable 2026/02/05 18:26:56 ❌ Operation 'Deploy application ocp-cassandra' failed after 3 attempts. Final error: Error during command execution: ansible-playbook error: one or more host failed Command executed: /usr/local/bin/ansible-playbook --extra-vars {"admin_kubeconfig":"/home/jenkins/.kube/config","namespace":"test-oadp-440","non_admin_user":false,"use_role":"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra","user_kubeconfig":"/home/jenkins/.kube/config","with_deploy":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml exit status 2 [FAILED] in [It] - /alabama/cspi/test_common/backup_restore_app_case.go:49 @ 02/05/26 18:26:56.325 < Exit [It] [tc-id:OADP-440][interop] [Tier0] [vf:data-mover] Cassandra application @ 02/05/26 18:26:56.325 (14m51.492s) > Enter [JustAfterEach] TOP-LEVEL @ 02/05/26 18:26:56.325 2026/02/05 18:26:56 Using Must-gather image: registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 STEP: Get the failed spec name @ 02/05/26 18:26:56.326 2026/02/05 18:26:56 The failed spec name is: [datamover] DataMover: Backup/Restore stateful application with CSI [tc-id:OADP-440][interop] [Tier0] [vf:data-mover] Cassandra application STEP: Create a folder for all must-gather files if it doesn't exists already @ 02/05/26 18:26:56.326 STEP: Create a folder for the failed spec if it doesn't exists already @ 02/05/26 18:26:56.326 STEP: Run must-gather because the spec failed @ 02/05/26 18:26:56.326 2026/02/05 18:26:56 Log the present working directory path:- /alabama/cspi/e2e 2026/02/05 18:26:56 [adm must-gather --dest-dir /alabama/cspi/e2e/logs/It_datamover_DataMover_Backup_Restore_stateful_application_with_CSI_tc-id_OADP-440_interop_Tier0_vf_data-mover_Cassandra_application --image registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3] 2026/02/05 18:27:16 Log all the files present in /alabama/cspi/e2e/logs directory 2026/02/05 18:27:16 It_Backup_hooks_tests_Pre_exec_hook_tc-id_OADP-92_interop_smoke_Tier0_vf_backup-hooks_Cassandra_app_with_Restic 2026/02/05 18:27:16 It_datamover_DataMover_Backup_Restore_stateful_application_with_CSI_tc-id_OADP-440_interop_Tier0_vf_data-mover_Cassandra_application STEP: Find must-gather folder and rename it to a shorter more readable name @ 02/05/26 18:27:16.934 The folder logs/It_datamover_DataMover_Backup_Restore_stateful_application_with_CSI_tc-id_OADP-440_interop_Tier0_vf_data-mover_Cassandra_application/must-gather already exists, skipping renaming the folder Secret deletion flag: true Deleting cloud credentials secret cloud-credentials in namespace openshift-adp < Exit [JustAfterEach] TOP-LEVEL @ 02/05/26 18:27:16.95 (20.624s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 18:27:16.95 2026/02/05 18:27:16 Cleaning app 2026/02/05 18:27:16 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Remove namespace test-oadp-440] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=16  changed=5  unreachable=0 failed=0 skipped=22  rescued=0 ignored=0 2026/02/05 18:27:47 2026-02-05 18:27:18,762 p=62004 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:27:18,763 p=62004 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:27:19,093 p=62004 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:27:19,093 p=62004 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:27:19,415 p=62004 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:27:19,415 p=62004 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:27:19,744 p=62004 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:27:19,744 p=62004 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:27:19,761 p=62004 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:27:19,762 p=62004 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:27:19,762 p=62004 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:27:19,781 p=62004 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:27:19,781 p=62004 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:27:19,795 p=62004 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:27:19,796 p=62004 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:27:20,202 p=62004 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:27:20,203 p=62004 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:27:20,203 p=62004 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:27:20,203 p=62004 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:27:20,231 p=62004 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:27:20,231 p=62004 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:27:20,252 p=62004 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:27:20,252 p=62004 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:27:20,255 p=62004 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:27:20,862 p=62004 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:27:20,862 p=62004 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:27:46,996 p=62004 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra : Remove namespace test-oadp-440] *** 2026-02-05 18:27:46,997 p=62004 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:27:46,997 p=62004 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:27:46,997 p=62004 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:27:46,998 p=62004 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:27:46,998 p=62004 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:27:47,372 p=62004 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:27:47,372 p=62004 u=1001930000 n=ansible INFO| localhost : ok=16 changed=5 unreachable=0 failed=0 skipped=22 rescued=0 ignored=0 < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 18:27:47.432 (30.482s) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 18:27:47.432 2026/02/05 18:27:47 Cleaning setup resources for the backup 2026/02/05 18:27:47 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 18:27:47 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2026/02/05 18:27:47 Deleting VolumeSnapshotClass 'example-snapclass' < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 18:27:47.462 (30ms) > Enter [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 18:27:47.462 2026/02/05 18:27:47 Deleting DPA CR < Exit [DeferCleanup (Each)] TOP-LEVEL @ 02/05/26 18:27:47.479 (17ms) • [FAILED] [2823.570 seconds] [datamover] DataMover: Backup/Restore stateful application with CSI  [It] [tc-id:OADP-440][interop] [Tier0] [vf:data-mover] Cassandra application /alabama/cspi/e2e/app_backup/backup_restore_datamover.go:50 [FAILED] Unexpected error: <*fmt.wrapError | 0xc000a4e040>: operation 'Deploy application ocp-cassandra' failed after 3 attempts: Error during command execution: ansible-playbook error: one or more host failed Command executed: /usr/local/bin/ansible-playbook --extra-vars {"admin_kubeconfig":"/home/jenkins/.kube/config","namespace":"test-oadp-440","non_admin_user":false,"use_role":"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra","user_kubeconfig":"/home/jenkins/.kube/config","with_deploy":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml exit status 2 { msg: "operation 'Deploy application ocp-cassandra' failed after 3 attempts: Error during command execution: ansible-playbook error: one or more host failed\n\nCommand executed: /usr/local/bin/ansible-playbook --extra-vars {\"admin_kubeconfig\":\"/home/jenkins/.kube/config\",\"namespace\":\"test-oadp-440\",\"non_admin_user\":false,\"use_role\":\"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra\",\"user_kubeconfig\":\"/home/jenkins/.kube/config\",\"with_deploy\":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml\n\nexit status 2", err: <*errors.Error | 0xc000a5c0c0>{ context: "(DefaultExecute::Execute)", message: "Error during command execution: ansible-playbook error: one or more host failed\n\nCommand executed: /usr/local/bin/ansible-playbook --extra-vars {\"admin_kubeconfig\":\"/home/jenkins/.kube/config\",\"namespace\":\"test-oadp-440\",\"non_admin_user\":false,\"use_role\":\"/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-cassandra\",\"user_kubeconfig\":\"/home/jenkins/.kube/config\",\"with_deploy\":true} --connection local /alabama/cspi/sample-applications/ansible/main.yml\n\nexit status 2", wrappedErrors: nil, }, } occurred In [It] at: /alabama/cspi/test_common/backup_restore_app_case.go:49 @ 02/05/26 18:26:56.325 There were additional failures detected. To view them in detail run ginkgo -vv ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ Backup restore tests Application backup [tc-id:OADP-371] [interop] [smoke] [Tier0] [vf:fsb-restic] MySQL application with Restic [mr-check] /alabama/cspi/e2e/app_backup/backup_restore.go:48 > Enter [BeforeEach] TOP-LEVEL @ 02/05/26 18:27:47.479 < Exit [BeforeEach] TOP-LEVEL @ 02/05/26 18:27:47.479 (0s) > Enter [BeforeEach] Backup restore tests @ 02/05/26 18:27:47.479 < Exit [BeforeEach] Backup restore tests @ 02/05/26 18:27:47.487 (8ms) > Enter [JustBeforeEach] TOP-LEVEL @ 02/05/26 18:27:47.487 < Exit [JustBeforeEach] TOP-LEVEL @ 02/05/26 18:27:47.487 (0s) > Enter [It] [tc-id:OADP-371] [interop] [smoke] [Tier0] [vf:fsb-restic] MySQL application with Restic @ 02/05/26 18:27:47.487 2026/02/05 18:27:47 Delete all downloadrequest mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-3e1df9ce-1e99-45ea-a401-8f24e62abe2e mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-49e79088-43de-4ccb-87b1-e97de7bbd3a3 mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-4edd8791-66aa-4844-b9a8-11224b35255b mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-580fdf55-ed0b-47cd-9bdb-5da5bf9fce16 mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-9f5ef8d4-5c20-4aae-a20d-b2cdc864c7bb mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-a82ca05c-cfc9-4b50-b701-7974dd12fa45 mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-c645b3b6-d08f-4191-989d-401eb89fc9dd mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-d3a49d1c-12f2-43c5-9c12-3043ccd7a05a mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-fddfc149-2789-44e0-8470-9d99c9689859 ocp-datavolume-5d53c5a8-02b2-11f1-a828-0a58ac1896e8-5fd61ee4-3bb7-4068-b82a-6a434f6c6859 ocp-datavolume-5d53c5a8-02b2-11f1-a828-0a58ac1896e8-b9833195-c8d8-4410-bbe6-f0a7ed28f893 STEP: Create DPA CR @ 02/05/26 18:27:47.705 2026/02/05 18:27:47 restic 2026/02/05 18:27:47 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "8595d7ed-a374-4e4a-8542-f70b83caa339", "resourceVersion": "186120", "generation": 1, "creationTimestamp": "2026-02-05T18:27:47Z", "managedFields": [ { "manager": "e2e.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T18:27:47Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:nodeAgent": { ".": {}, "f:enable": {}, "f:podConfig": { ".": {}, "f:resourceAllocations": {} }, "f:uploaderType": {} }, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift" ], "disableFsBackup": false }, "nodeAgent": { "enable": true, "podConfig": { "resourceAllocations": {} }, "uploaderType": "restic" } }, "features": null, "logFormat": "text" }, "status": {} } Delete all the backups that remained in the phase InProgress Deleting backup CRs in progress Deletion of backup CRs in progress completed Delete all the restores that remained in the phase InProgress Deleting restore CRs in progress Deletion of restore CRs in progress completed STEP: Verify DPA CR setup @ 02/05/26 18:27:47.738 2026/02/05 18:27:47 Waiting for velero pod to be running 2026/02/05 18:27:47 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete' 2026/02/05 18:27:47 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "8595d7ed-a374-4e4a-8542-f70b83caa339", "resourceVersion": "186120", "generation": 1, "creationTimestamp": "2026-02-05T18:27:47Z", "managedFields": [ { "manager": "e2e.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T18:27:47Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:nodeAgent": { ".": {}, "f:enable": {}, "f:podConfig": { ".": {}, "f:resourceAllocations": {} }, "f:uploaderType": {} }, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift" ], "disableFsBackup": false }, "nodeAgent": { "enable": true, "podConfig": { "resourceAllocations": {} }, "uploaderType": "restic" } }, "features": null, "logFormat": "text" }, "status": {} } 2026/02/05 18:27:52 DPA successfully reconciled STEP: Prepare backup resources, depending on the volumes backup type @ 02/05/26 18:27:52.783 2026/02/05 18:27:52 Checking for correct number of running NodeAgent pods... STEP: Installing application for case mysql @ 02/05/26 18:27:52.795 2026/02/05 18:27:52 🔄 [Attempt 1/3] Executing operation: Deploy application ocp-mysql 2026/02/05 18:27:52 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check namespace test-oadp-1077] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Create namespace] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check if SecurityContextConstraints are available] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Set has_scc variable] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Deploy a mysql pod] *** changed: [localhost] FAILED - RETRYING: [localhost]: Check pod status (30 retries left). FAILED - RETRYING: [localhost]: Check pod status (29 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check pod status] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Copy mysql provision script to pod] *** changed: [localhost] FAILED - RETRYING: [localhost]: Wait until service ready for connections (30 retries left). FAILED - RETRYING: [localhost]: Wait until service ready for connections (29 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Provision the mysql database] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Add dummy data into mysql-data1 pvc] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Create md5 hashes for the files] *** changed: [localhost] Pausing for 30 seconds TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Pause After Create md5 hashes for the files] *** ok: [localhost] PLAY RECAP ********************************************************************* localhost : ok=27  changed=11  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026/02/05 18:28:59 2026-02-05 18:27:54,472 p=62235 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:27:54,473 p=62235 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:27:54,786 p=62235 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:27:54,786 p=62235 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:27:55,101 p=62235 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:27:55,101 p=62235 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:27:55,414 p=62235 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:27:55,415 p=62235 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:27:55,433 p=62235 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:27:55,433 p=62235 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:27:55,433 p=62235 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:27:55,452 p=62235 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:27:55,452 p=62235 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:27:55,470 p=62235 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:27:55,471 p=62235 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:27:55,882 p=62235 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:27:55,882 p=62235 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:27:55,883 p=62235 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:27:55,883 p=62235 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:27:55,910 p=62235 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:27:55,910 p=62235 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:27:55,931 p=62235 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:27:55,931 p=62235 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:27:55,934 p=62235 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:27:56,532 p=62235 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:27:56,532 p=62235 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:27:57,626 p=62235 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check namespace test-oadp-1077] *** 2026-02-05 18:27:57,627 p=62235 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:27:57,627 p=62235 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:27:57,627 p=62235 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:27:57,627 p=62235 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:27:57,628 p=62235 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:27:57,971 p=62235 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Create namespace] *** 2026-02-05 18:27:57,972 p=62235 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:27:58,921 p=62235 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check if SecurityContextConstraints are available] *** 2026-02-05 18:27:58,922 p=62235 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:27:58,952 p=62235 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Set has_scc variable] *** 2026-02-05 18:27:58,952 p=62235 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:28:00,148 p=62235 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Deploy a mysql pod] *** 2026-02-05 18:28:00,149 p=62235 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:28:01,080 p=62235 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pod status (30 retries left). 2026-02-05 18:28:06,954 p=62235 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pod status (29 retries left). 2026-02-05 18:28:12,846 p=62235 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check pod status] *** 2026-02-05 18:28:12,846 p=62235 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:28:13,361 p=62235 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Copy mysql provision script to pod] *** 2026-02-05 18:28:13,362 p=62235 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:28:13,758 p=62235 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until service ready for connections (30 retries left). 2026-02-05 18:28:20,254 p=62235 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until service ready for connections (29 retries left). 2026-02-05 18:28:25,586 p=62235 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] *** 2026-02-05 18:28:25,586 p=62235 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:28:27,762 p=62235 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Provision the mysql database] *** 2026-02-05 18:28:27,763 p=62235 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:28:28,625 p=62235 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Add dummy data into mysql-data1 pvc] *** 2026-02-05 18:28:28,626 p=62235 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:28:29,262 p=62235 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Create md5 hashes for the files] *** 2026-02-05 18:28:29,262 p=62235 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:28:29,284 p=62235 u=1001930000 n=ansible INFO| Pausing for 30 seconds 2026-02-05 18:28:59,288 p=62235 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Pause After Create md5 hashes for the files] *** 2026-02-05 18:28:59,288 p=62235 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:28:59,420 p=62235 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:28:59,420 p=62235 u=1001930000 n=ansible INFO| localhost : ok=27 changed=11 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 STEP: Verify Application deployment @ 02/05/26 18:28:59.489 2026/02/05 18:28:59 Using admin kubeconfig for with_validate operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check mysql pod status] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Query the inserted data] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Validate test1 file has correct md5 hash] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=19  changed=7  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026/02/05 18:29:06 2026-02-05 18:29:01,234 p=62792 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:29:01,235 p=62792 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:29:01,551 p=62792 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:29:01,551 p=62792 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:29:01,864 p=62792 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:29:01,864 p=62792 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:29:02,183 p=62792 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:29:02,183 p=62792 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:29:02,202 p=62792 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:29:02,202 p=62792 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:29:02,202 p=62792 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:29:02,223 p=62792 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:29:02,223 p=62792 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:29:02,239 p=62792 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:29:02,240 p=62792 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:29:02,659 p=62792 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:29:02,660 p=62792 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:29:02,660 p=62792 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:29:02,660 p=62792 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:29:02,686 p=62792 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:29:02,687 p=62792 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:29:02,707 p=62792 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:29:02,707 p=62792 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:29:02,710 p=62792 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:29:03,308 p=62792 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:29:03,308 p=62792 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:29:04,632 p=62792 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check mysql pod status] *** 2026-02-05 18:29:04,632 p=62792 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:29:04,632 p=62792 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:29:04,633 p=62792 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:29:04,633 p=62792 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:29:04,633 p=62792 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:29:05,095 p=62792 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] *** 2026-02-05 18:29:05,095 p=62792 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:29:05,572 p=62792 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Query the inserted data] *** 2026-02-05 18:29:05,572 p=62792 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:29:06,219 p=62792 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Validate test1 file has correct md5 hash] *** 2026-02-05 18:29:06,219 p=62792 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:29:06,224 p=62792 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:29:06,224 p=62792 u=1001930000 n=ansible INFO| localhost : ok=19 changed=7 unreachable=0 failed=0 skipped=17 rescued=0 ignored=0 2026/02/05 18:29:06 {{ } { } [{{ } {mysql-data test-oadp-1077 ec3ad0a5-4f4b-4c13-a717-064b417c935f 186511 0 2026-02-05 18:28:00 +0000 UTC map[app:mysql testlabel:selectors testlabel2:foo] map[pv.kubernetes.io/bind-completed:yes pv.kubernetes.io/bound-by-controller:yes reclaimspace.csiaddons.openshift.io/cronjob:mysql-data-1770316080 reclaimspace.csiaddons.openshift.io/schedule:@weekly volume.beta.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com volume.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com] [] [kubernetes.io/pvc-protection] [{OpenAPI-Generator Update v1 2026-02-05 18:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:app":{},"f:testlabel":{},"f:testlabel2":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}} } {csi-addons-manager Update v1 2026-02-05 18:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:reclaimspace.csiaddons.openshift.io/cronjob":{},"f:reclaimspace.csiaddons.openshift.io/schedule":{}}}} } {kube-controller-manager Update v1 2026-02-05 18:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:pv.kubernetes.io/bind-completed":{},"f:pv.kubernetes.io/bound-by-controller":{},"f:volume.beta.kubernetes.io/storage-provisioner":{},"f:volume.kubernetes.io/storage-provisioner":{}}},"f:spec":{"f:volumeName":{}}} } {kube-controller-manager Update v1 2026-02-05 18:28:00 +0000 UTC FieldsV1 {"f:status":{"f:accessModes":{},"f:capacity":{".":{},"f:storage":{}},"f:phase":{}}} status}]} {[ReadWriteOnce] nil {map[] map[storage:{{2147483648 0} {} 2Gi BinarySI}]} pvc-ec3ad0a5-4f4b-4c13-a717-064b417c935f 0xc000ce3230 0xc000ce3250 nil nil } {Bound [ReadWriteOnce] map[storage:{{2147483648 0} {} 2Gi BinarySI}] [] map[] map[] nil}} {{ } {mysql-data1 test-oadp-1077 adcb1b08-dbb4-49fc-b339-a8e3947fdfd0 186513 0 2026-02-05 18:28:00 +0000 UTC map[app:mysql testlabel:selectors testlabel2:foo] map[pv.kubernetes.io/bind-completed:yes pv.kubernetes.io/bound-by-controller:yes reclaimspace.csiaddons.openshift.io/cronjob:mysql-data1-1770316080 reclaimspace.csiaddons.openshift.io/schedule:@weekly volume.beta.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com volume.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com] [] [kubernetes.io/pvc-protection] [{OpenAPI-Generator Update v1 2026-02-05 18:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:app":{},"f:testlabel":{},"f:testlabel2":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}} } {csi-addons-manager Update v1 2026-02-05 18:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:reclaimspace.csiaddons.openshift.io/cronjob":{},"f:reclaimspace.csiaddons.openshift.io/schedule":{}}}} } {kube-controller-manager Update v1 2026-02-05 18:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:pv.kubernetes.io/bind-completed":{},"f:pv.kubernetes.io/bound-by-controller":{},"f:volume.beta.kubernetes.io/storage-provisioner":{},"f:volume.kubernetes.io/storage-provisioner":{}}},"f:spec":{"f:volumeName":{}}} } {kube-controller-manager Update v1 2026-02-05 18:28:00 +0000 UTC FieldsV1 {"f:status":{"f:accessModes":{},"f:capacity":{".":{},"f:storage":{}},"f:phase":{}}} status}]} {[ReadWriteOnce] nil {map[] map[storage:{{2147483648 0} {} 2Gi BinarySI}]} pvc-adcb1b08-dbb4-49fc-b339-a8e3947fdfd0 0xc000ce3490 0xc000ce34b0 nil nil } {Bound [ReadWriteOnce] map[storage:{{2147483648 0} {} 2Gi BinarySI}] [] map[] map[] nil}}]} STEP: Creating backup mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8 @ 02/05/26 18:29:06.287 2026/02/05 18:29:06 Wait until backup mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8 is completed backup phase: Completed 2026/02/05 18:29:26 Verify the PodVolumeBackup is completed successfully and BackupRepository type is matching with DPA.nodeAgent.uploaderType 2026/02/05 18:29:26 apiVersion: velero.io/v1 kind: PodVolumeBackup metadata: annotations: velero.io/pvc-name: mysql-data creationTimestamp: "2026-02-05T18:29:10Z" generateName: mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8- generation: 4 labels: velero.io/backup-name: mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8 velero.io/backup-uid: 7add4a83-f825-4a0f-b2cc-956f8d3a3e05 velero.io/pvc-uid: ec3ad0a5-4f4b-4c13-a717-064b417c935f managedFields: - apiVersion: velero.io/v1 fieldsType: FieldsV1 fieldsV1: f:metadata: f:annotations: .: {} f:velero.io/pvc-name: {} f:generateName: {} f:labels: .: {} f:velero.io/backup-name: {} f:velero.io/backup-uid: {} f:velero.io/pvc-uid: {} f:ownerReferences: .: {} k:{"uid":"7add4a83-f825-4a0f-b2cc-956f8d3a3e05"}: {} f:spec: .: {} f:backupStorageLocation: {} f:node: {} f:pod: {} f:repoIdentifier: {} f:tags: .: {} f:backup: {} f:backup-uid: {} f:ns: {} f:pod: {} f:pod-uid: {} f:pvc-uid: {} f:volume: {} f:uploaderType: {} f:volume: {} f:status: .: {} f:progress: {} manager: velero-server operation: Update time: "2026-02-05T18:29:10Z" - apiVersion: velero.io/v1 fieldsType: FieldsV1 fieldsV1: f:status: f:completionTimestamp: {} f:path: {} f:phase: {} f:progress: f:bytesDone: {} f:totalBytes: {} f:snapshotID: {} f:startTimestamp: {} manager: node-agent-server operation: Update time: "2026-02-05T18:29:13Z" name: mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8-875lr namespace: openshift-adp ownerReferences: - apiVersion: velero.io/v1 controller: true kind: Backup name: mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8 uid: 7add4a83-f825-4a0f-b2cc-956f8d3a3e05 resourceVersion: "187600" uid: 936e7dc0-b38a-4a03-ac83-c6800171e72a spec: backupStorageLocation: ts-dpa-1 node: ip-10-0-60-83.us-east-2.compute.internal pod: kind: Pod name: mysql-86ffb49df-djk5m namespace: test-oadp-1077 uid: 6ccb4919-8cb7-469a-9f51-f9cc3b88e7ff repoIdentifier: s3:s3-us-east-2.amazonaws.com/ci-op-988mlksm-interopoadp/velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8/restic/test-oadp-1077 tags: backup: mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8 backup-uid: 7add4a83-f825-4a0f-b2cc-956f8d3a3e05 ns: test-oadp-1077 pod: mysql-86ffb49df-djk5m pod-uid: 6ccb4919-8cb7-469a-9f51-f9cc3b88e7ff pvc-uid: ec3ad0a5-4f4b-4c13-a717-064b417c935f volume: mysql-data uploaderType: restic volume: mysql-data status: completionTimestamp: "2026-02-05T18:29:13Z" path: /host_pods/6ccb4919-8cb7-469a-9f51-f9cc3b88e7ff/volumes/kubernetes.io~csi/pvc-ec3ad0a5-4f4b-4c13-a717-064b417c935f/mount phase: Completed progress: bytesDone: 107854713 totalBytes: 107854713 snapshotID: 07424d88 startTimestamp: "2026-02-05T18:29:10Z" 2026/02/05 18:29:26 apiVersion: velero.io/v1 kind: PodVolumeBackup metadata: annotations: velero.io/pvc-name: mysql-data1 creationTimestamp: "2026-02-05T18:29:10Z" generateName: mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8- generation: 4 labels: velero.io/backup-name: mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8 velero.io/backup-uid: 7add4a83-f825-4a0f-b2cc-956f8d3a3e05 velero.io/pvc-uid: adcb1b08-dbb4-49fc-b339-a8e3947fdfd0 managedFields: - apiVersion: velero.io/v1 fieldsType: FieldsV1 fieldsV1: f:metadata: f:annotations: .: {} f:velero.io/pvc-name: {} f:generateName: {} f:labels: .: {} f:velero.io/backup-name: {} f:velero.io/backup-uid: {} f:velero.io/pvc-uid: {} f:ownerReferences: .: {} k:{"uid":"7add4a83-f825-4a0f-b2cc-956f8d3a3e05"}: {} f:spec: .: {} f:backupStorageLocation: {} f:node: {} f:pod: {} f:repoIdentifier: {} f:tags: .: {} f:backup: {} f:backup-uid: {} f:ns: {} f:pod: {} f:pod-uid: {} f:pvc-uid: {} f:volume: {} f:uploaderType: {} f:volume: {} f:status: .: {} f:progress: {} manager: velero-server operation: Update time: "2026-02-05T18:29:10Z" - apiVersion: velero.io/v1 fieldsType: FieldsV1 fieldsV1: f:status: f:completionTimestamp: {} f:path: {} f:phase: {} f:progress: f:bytesDone: {} f:totalBytes: {} f:snapshotID: {} f:startTimestamp: {} manager: node-agent-server operation: Update time: "2026-02-05T18:29:18Z" name: mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8-9kwbj namespace: openshift-adp ownerReferences: - apiVersion: velero.io/v1 controller: true kind: Backup name: mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8 uid: 7add4a83-f825-4a0f-b2cc-956f8d3a3e05 resourceVersion: "187678" uid: 7fdc9c37-27aa-4108-83f8-57f129bdc3b6 spec: backupStorageLocation: ts-dpa-1 node: ip-10-0-60-83.us-east-2.compute.internal pod: kind: Pod name: mysql-86ffb49df-djk5m namespace: test-oadp-1077 uid: 6ccb4919-8cb7-469a-9f51-f9cc3b88e7ff repoIdentifier: s3:s3-us-east-2.amazonaws.com/ci-op-988mlksm-interopoadp/velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8/restic/test-oadp-1077 tags: backup: mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8 backup-uid: 7add4a83-f825-4a0f-b2cc-956f8d3a3e05 ns: test-oadp-1077 pod: mysql-86ffb49df-djk5m pod-uid: 6ccb4919-8cb7-469a-9f51-f9cc3b88e7ff pvc-uid: adcb1b08-dbb4-49fc-b339-a8e3947fdfd0 volume: mysql-data1 uploaderType: restic volume: mysql-data1 status: completionTimestamp: "2026-02-05T18:29:18Z" path: /host_pods/6ccb4919-8cb7-469a-9f51-f9cc3b88e7ff/volumes/kubernetes.io~csi/pvc-adcb1b08-dbb4-49fc-b339-a8e3947fdfd0/mount phase: Completed progress: bytesDone: 104857640 totalBytes: 104857640 snapshotID: e08b0343 startTimestamp: "2026-02-05T18:29:16Z" STEP: Verify backup mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8 has completed successfully @ 02/05/26 18:29:26.313 2026/02/05 18:29:26 Backup for case mysql succeeded STEP: Delete the appplication resources mysql @ 02/05/26 18:29:26.361 STEP: Cleanup Application for case mysql @ 02/05/26 18:29:26.361 2026/02/05 18:29:26 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Remove namespace test-oadp-1077] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=16  changed=5  unreachable=0 failed=0 skipped=20  rescued=0 ignored=0 2026/02/05 18:29:51 2026-02-05 18:29:28,110 p=63117 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:29:28,111 p=63117 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:29:28,424 p=63117 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:29:28,424 p=63117 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:29:28,755 p=63117 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:29:28,756 p=63117 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:29:29,089 p=63117 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:29:29,089 p=63117 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:29:29,108 p=63117 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:29:29,108 p=63117 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:29:29,108 p=63117 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:29:29,132 p=63117 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:29:29,132 p=63117 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:29:29,148 p=63117 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:29:29,148 p=63117 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:29:29,577 p=63117 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:29:29,577 p=63117 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:29:29,577 p=63117 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:29:29,577 p=63117 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:29:29,608 p=63117 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:29:29,608 p=63117 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:29:29,631 p=63117 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:29:29,631 p=63117 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:29:29,634 p=63117 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:29:30,231 p=63117 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:29:30,231 p=63117 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:29:51,422 p=63117 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Remove namespace test-oadp-1077] *** 2026-02-05 18:29:51,423 p=63117 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:29:51,423 p=63117 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:29:51,423 p=63117 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:29:51,424 p=63117 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:29:51,424 p=63117 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:29:51,773 p=63117 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:29:51,774 p=63117 u=1001930000 n=ansible INFO| localhost : ok=16 changed=5 unreachable=0 failed=0 skipped=20 rescued=0 ignored=0 2026/02/05 18:29:51 Creating restore mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8 for case mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8 STEP: Create restore mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8 from backup mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8 @ 02/05/26 18:29:51.829 2026/02/05 18:29:51 Wait until restore mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8 is complete restore phase: InProgress restore phase: InProgress restore phase: Completed 2026/02/05 18:30:21 Verify the PodVolumeBackup and PodVolumeRestore count is equal 2026/02/05 18:30:21 Verify the PodVolumeRestore is completed sucessfully and uploaderType is matching 2026/02/05 18:30:21 apiVersion: velero.io/v1 kind: PodVolumeRestore metadata: creationTimestamp: "2026-02-05T18:29:54Z" generateName: mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8- generation: 5 labels: velero.io/pod-uid: 9bdd61c6-53f9-42dc-888a-a0c947cb0a3f velero.io/pvc-uid: 2e366b09-73dc-431c-b971-59f8b0f8ad55 velero.io/restore-name: mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8 velero.io/restore-uid: cf3e5170-3dff-4014-ab10-6344407b6eb7 managedFields: - apiVersion: velero.io/v1 fieldsType: FieldsV1 fieldsV1: f:metadata: f:generateName: {} f:labels: .: {} f:velero.io/pod-uid: {} f:velero.io/pvc-uid: {} f:velero.io/restore-name: {} f:velero.io/restore-uid: {} f:ownerReferences: .: {} k:{"uid":"cf3e5170-3dff-4014-ab10-6344407b6eb7"}: {} f:spec: .: {} f:backupStorageLocation: {} f:pod: {} f:repoIdentifier: {} f:snapshotID: {} f:sourceNamespace: {} f:uploaderType: {} f:volume: {} f:status: .: {} f:progress: {} manager: velero-server operation: Update time: "2026-02-05T18:29:54Z" - apiVersion: velero.io/v1 fieldsType: FieldsV1 fieldsV1: f:status: f:completionTimestamp: {} f:phase: {} f:progress: f:bytesDone: {} f:totalBytes: {} f:startTimestamp: {} manager: node-agent-server operation: Update time: "2026-02-05T18:30:18Z" name: mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8-c92j6 namespace: openshift-adp ownerReferences: - apiVersion: velero.io/v1 controller: true kind: Restore name: mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8 uid: cf3e5170-3dff-4014-ab10-6344407b6eb7 resourceVersion: "188743" uid: 3256a044-346b-4bc2-a170-0417288ad44b spec: backupStorageLocation: ts-dpa-1 pod: kind: Pod name: mysql-86ffb49df-djk5m namespace: test-oadp-1077 uid: 9bdd61c6-53f9-42dc-888a-a0c947cb0a3f repoIdentifier: s3:s3-us-east-2.amazonaws.com/ci-op-988mlksm-interopoadp/velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8/restic/test-oadp-1077 snapshotID: 07424d88 sourceNamespace: test-oadp-1077 uploaderType: restic volume: mysql-data status: completionTimestamp: "2026-02-05T18:30:18Z" phase: Completed progress: bytesDone: 107854713 totalBytes: 107854713 startTimestamp: "2026-02-05T18:30:16Z" 2026/02/05 18:30:21 apiVersion: velero.io/v1 kind: PodVolumeRestore metadata: creationTimestamp: "2026-02-05T18:29:54Z" generateName: mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8- generation: 5 labels: velero.io/pod-uid: 9bdd61c6-53f9-42dc-888a-a0c947cb0a3f velero.io/pvc-uid: 7d0ffc86-c0b4-4882-8dd3-d9d41ace8745 velero.io/restore-name: mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8 velero.io/restore-uid: cf3e5170-3dff-4014-ab10-6344407b6eb7 managedFields: - apiVersion: velero.io/v1 fieldsType: FieldsV1 fieldsV1: f:metadata: f:generateName: {} f:labels: .: {} f:velero.io/pod-uid: {} f:velero.io/pvc-uid: {} f:velero.io/restore-name: {} f:velero.io/restore-uid: {} f:ownerReferences: .: {} k:{"uid":"cf3e5170-3dff-4014-ab10-6344407b6eb7"}: {} f:spec: .: {} f:backupStorageLocation: {} f:pod: {} f:repoIdentifier: {} f:snapshotID: {} f:sourceNamespace: {} f:uploaderType: {} f:volume: {} f:status: .: {} f:progress: {} manager: velero-server operation: Update time: "2026-02-05T18:29:54Z" - apiVersion: velero.io/v1 fieldsType: FieldsV1 fieldsV1: f:status: f:completionTimestamp: {} f:phase: {} f:progress: f:bytesDone: {} f:totalBytes: {} f:startTimestamp: {} manager: node-agent-server operation: Update time: "2026-02-05T18:30:13Z" name: mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8-p8mkv namespace: openshift-adp ownerReferences: - apiVersion: velero.io/v1 controller: true kind: Restore name: mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8 uid: cf3e5170-3dff-4014-ab10-6344407b6eb7 resourceVersion: "188680" uid: 7f125235-d2e6-4d76-a5d0-cc2d064b00fb spec: backupStorageLocation: ts-dpa-1 pod: kind: Pod name: mysql-86ffb49df-djk5m namespace: test-oadp-1077 uid: 9bdd61c6-53f9-42dc-888a-a0c947cb0a3f repoIdentifier: s3:s3-us-east-2.amazonaws.com/ci-op-988mlksm-interopoadp/velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8/restic/test-oadp-1077 snapshotID: e08b0343 sourceNamespace: test-oadp-1077 uploaderType: restic volume: mysql-data1 status: completionTimestamp: "2026-02-05T18:30:13Z" phase: Completed progress: bytesDone: 104857640 totalBytes: 104857640 startTimestamp: "2026-02-05T18:30:11Z" STEP: Verify restore mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8has completed successfully @ 02/05/26 18:30:21.908 STEP: Verify Application restore @ 02/05/26 18:30:21.915 STEP: Verify Application deployment for case mysql @ 02/05/26 18:30:21.915 2026/02/05 18:30:21 Using admin kubeconfig for with_validate operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check mysql pod status] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Query the inserted data] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Validate test1 file has correct md5 hash] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=19  changed=7  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026/02/05 18:30:28 2026-02-05 18:30:23,630 p=63346 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:30:23,630 p=63346 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:30:23,941 p=63346 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:30:23,941 p=63346 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:30:24,262 p=63346 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:30:24,263 p=63346 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:30:24,574 p=63346 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:30:24,574 p=63346 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:30:24,592 p=63346 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:30:24,592 p=63346 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:30:24,593 p=63346 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:30:24,612 p=63346 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:30:24,612 p=63346 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:30:24,627 p=63346 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:30:24,627 p=63346 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:30:25,043 p=63346 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:30:25,044 p=63346 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:30:25,044 p=63346 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:30:25,044 p=63346 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:30:25,071 p=63346 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:30:25,071 p=63346 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:30:25,092 p=63346 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:30:25,092 p=63346 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:30:25,095 p=63346 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:30:25,698 p=63346 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:30:25,698 p=63346 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:30:27,041 p=63346 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check mysql pod status] *** 2026-02-05 18:30:27,042 p=63346 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:30:27,042 p=63346 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:30:27,042 p=63346 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:30:27,042 p=63346 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:30:27,043 p=63346 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:30:27,562 p=63346 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] *** 2026-02-05 18:30:27,562 p=63346 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:30:28,040 p=63346 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Query the inserted data] *** 2026-02-05 18:30:28,041 p=63346 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:30:28,676 p=63346 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Validate test1 file has correct md5 hash] *** 2026-02-05 18:30:28,677 p=63346 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:30:28,681 p=63346 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:30:28,681 p=63346 u=1001930000 n=ansible INFO| localhost : ok=19 changed=7 unreachable=0 failed=0 skipped=17 rescued=0 ignored=0 < Exit [It] [tc-id:OADP-371] [interop] [smoke] [Tier0] [vf:fsb-restic] MySQL application with Restic @ 02/05/26 18:30:28.738 (2m41.251s) > Enter [JustAfterEach] TOP-LEVEL @ 02/05/26 18:30:28.738 2026/02/05 18:30:28 Using Must-gather image: registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 Secret deletion flag: true Deleting cloud credentials secret cloud-credentials in namespace openshift-adp < Exit [JustAfterEach] TOP-LEVEL @ 02/05/26 18:30:28.747 (9ms) > Enter [DeferCleanup (Each)] Application backup @ 02/05/26 18:30:28.747 < Exit [DeferCleanup (Each)] Application backup @ 02/05/26 18:30:28.752 (5ms) > Enter [DeferCleanup (Each)] Application backup @ 02/05/26 18:30:28.752 < Exit [DeferCleanup (Each)] Application backup @ 02/05/26 18:30:28.752 (0s) > Enter [DeferCleanup (Each)] Application backup @ 02/05/26 18:30:28.752 2026/02/05 18:30:28 Cleaning app 2026/02/05 18:30:28 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Remove namespace test-oadp-1077] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=16  changed=5  unreachable=0 failed=0 skipped=20  rescued=0 ignored=0 2026/02/05 18:30:59 2026-02-05 18:30:30,509 p=63672 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:30:30,509 p=63672 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:30:30,831 p=63672 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:30:30,831 p=63672 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:30:31,173 p=63672 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:30:31,174 p=63672 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:30:31,512 p=63672 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:30:31,513 p=63672 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:30:31,531 p=63672 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:30:31,531 p=63672 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:30:31,531 p=63672 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:30:31,551 p=63672 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:30:31,551 p=63672 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:30:31,565 p=63672 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:30:31,566 p=63672 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:30:31,982 p=63672 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:30:31,983 p=63672 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:30:31,983 p=63672 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:30:31,983 p=63672 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:30:32,011 p=63672 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:30:32,011 p=63672 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:30:32,032 p=63672 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:30:32,032 p=63672 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:30:32,035 p=63672 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:30:32,637 p=63672 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:30:32,637 p=63672 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:30:58,796 p=63672 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Remove namespace test-oadp-1077] *** 2026-02-05 18:30:58,797 p=63672 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:30:58,797 p=63672 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:30:58,797 p=63672 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:30:58,798 p=63672 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:30:58,798 p=63672 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:30:59,170 p=63672 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:30:59,171 p=63672 u=1001930000 n=ansible INFO| localhost : ok=16 changed=5 unreachable=0 failed=0 skipped=20 rescued=0 ignored=0 < Exit [DeferCleanup (Each)] Application backup @ 02/05/26 18:30:59.232 (30.48s) > Enter [DeferCleanup (Each)] Application backup @ 02/05/26 18:30:59.232 2026/02/05 18:30:59 Cleaning setup resources for the backup < Exit [DeferCleanup (Each)] Application backup @ 02/05/26 18:30:59.232 (0s) > Enter [DeferCleanup (Each)] Application backup @ 02/05/26 18:30:59.232 2026/02/05 18:30:59 Deleting DPA CR < Exit [DeferCleanup (Each)] Application backup @ 02/05/26 18:30:59.245 (12ms) • [191.766 seconds] ------------------------------ Backup restore tests Application backup [tc-id:OADP-437][interop][smoke] [Tier0] [vf:fsb-kopia] MySQL application with filesystem, Kopia [mr-check] /alabama/cspi/e2e/app_backup/backup_restore.go:62 > Enter [BeforeEach] TOP-LEVEL @ 02/05/26 18:30:59.245 < Exit [BeforeEach] TOP-LEVEL @ 02/05/26 18:30:59.245 (0s) > Enter [BeforeEach] Backup restore tests @ 02/05/26 18:30:59.245 < Exit [BeforeEach] Backup restore tests @ 02/05/26 18:30:59.252 (7ms) > Enter [JustBeforeEach] TOP-LEVEL @ 02/05/26 18:30:59.252 < Exit [JustBeforeEach] TOP-LEVEL @ 02/05/26 18:30:59.252 (0s) > Enter [It] [tc-id:OADP-437][interop][smoke] [Tier0] [vf:fsb-kopia] MySQL application with filesystem, Kopia @ 02/05/26 18:30:59.252 2026/02/05 18:30:59 Delete all downloadrequest No download requests are found STEP: Create DPA CR @ 02/05/26 18:30:59.258 2026/02/05 18:30:59 kopia 2026/02/05 18:30:59 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "2806e22f-ceb9-4008-b867-d535c9cdd3df", "resourceVersion": "189395", "generation": 1, "creationTimestamp": "2026-02-05T18:30:59Z", "managedFields": [ { "manager": "e2e.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T18:30:59Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:nodeAgent": { ".": {}, "f:enable": {}, "f:podConfig": { ".": {}, "f:resourceAllocations": {} }, "f:uploaderType": {} }, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift" ], "disableFsBackup": false }, "nodeAgent": { "enable": true, "podConfig": { "resourceAllocations": {} }, "uploaderType": "kopia" } }, "features": null, "logFormat": "text" }, "status": {} } Delete all the backups that remained in the phase InProgress Deleting backup CRs in progress Deletion of backup CRs in progress completed Delete all the restores that remained in the phase InProgress Deleting restore CRs in progress Deletion of restore CRs in progress completed STEP: Verify DPA CR setup @ 02/05/26 18:30:59.338 2026/02/05 18:30:59 Waiting for velero pod to be running 2026/02/05 18:30:59 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete' 2026/02/05 18:30:59 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "2806e22f-ceb9-4008-b867-d535c9cdd3df", "resourceVersion": "189395", "generation": 1, "creationTimestamp": "2026-02-05T18:30:59Z", "managedFields": [ { "manager": "e2e.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T18:30:59Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:nodeAgent": { ".": {}, "f:enable": {}, "f:podConfig": { ".": {}, "f:resourceAllocations": {} }, "f:uploaderType": {} }, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift" ], "disableFsBackup": false }, "nodeAgent": { "enable": true, "podConfig": { "resourceAllocations": {} }, "uploaderType": "kopia" } }, "features": null, "logFormat": "text" }, "status": {} } 2026/02/05 18:31:04 DPA successfully reconciled STEP: Prepare backup resources, depending on the volumes backup type @ 02/05/26 18:31:04.417 2026/02/05 18:31:04 Checking for correct number of running NodeAgent pods... STEP: Installing application for case mysql @ 02/05/26 18:31:04.432 2026/02/05 18:31:04 🔄 [Attempt 1/3] Executing operation: Deploy application ocp-mysql 2026/02/05 18:31:04 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check namespace test-oadp-437-kopia] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Create namespace] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check if SecurityContextConstraints are available] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Set has_scc variable] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Deploy a mysql pod] *** changed: [localhost] FAILED - RETRYING: [localhost]: Check pod status (30 retries left). FAILED - RETRYING: [localhost]: Check pod status (29 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check pod status] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Copy mysql provision script to pod] *** changed: [localhost] FAILED - RETRYING: [localhost]: Wait until service ready for connections (30 retries left). FAILED - RETRYING: [localhost]: Wait until service ready for connections (29 retries left). FAILED - RETRYING: [localhost]: Wait until service ready for connections (28 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Provision the mysql database] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Add dummy data into mysql-data1 pvc] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Create md5 hashes for the files] *** changed: [localhost] Pausing for 30 seconds TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Pause After Create md5 hashes for the files] *** ok: [localhost] PLAY RECAP ********************************************************************* localhost : ok=27  changed=11  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026/02/05 18:32:15 2026-02-05 18:31:06,146 p=63900 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:31:06,146 p=63900 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:31:06,461 p=63900 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:31:06,461 p=63900 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:31:06,777 p=63900 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:31:06,778 p=63900 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:31:07,105 p=63900 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:31:07,106 p=63900 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:31:07,124 p=63900 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:31:07,124 p=63900 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:31:07,124 p=63900 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:31:07,143 p=63900 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:31:07,144 p=63900 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:31:07,158 p=63900 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:31:07,159 p=63900 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:31:07,576 p=63900 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:31:07,577 p=63900 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:31:07,577 p=63900 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:31:07,577 p=63900 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:31:07,603 p=63900 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:31:07,604 p=63900 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:31:07,624 p=63900 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:31:07,624 p=63900 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:31:07,627 p=63900 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:31:08,228 p=63900 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:31:08,228 p=63900 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:31:09,308 p=63900 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check namespace test-oadp-437-kopia] *** 2026-02-05 18:31:09,309 p=63900 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:31:09,309 p=63900 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:31:09,309 p=63900 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:31:09,309 p=63900 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:31:09,309 p=63900 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:31:09,649 p=63900 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Create namespace] *** 2026-02-05 18:31:09,649 p=63900 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:31:10,614 p=63900 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check if SecurityContextConstraints are available] *** 2026-02-05 18:31:10,615 p=63900 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:31:10,647 p=63900 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Set has_scc variable] *** 2026-02-05 18:31:10,647 p=63900 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:31:11,899 p=63900 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Deploy a mysql pod] *** 2026-02-05 18:31:11,900 p=63900 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:31:12,876 p=63900 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pod status (30 retries left). 2026-02-05 18:31:18,755 p=63900 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pod status (29 retries left). 2026-02-05 18:31:24,715 p=63900 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check pod status] *** 2026-02-05 18:31:24,716 p=63900 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:31:25,303 p=63900 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Copy mysql provision script to pod] *** 2026-02-05 18:31:25,304 p=63900 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:31:25,746 p=63900 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until service ready for connections (30 retries left). 2026-02-05 18:31:31,090 p=63900 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until service ready for connections (29 retries left). 2026-02-05 18:31:36,473 p=63900 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until service ready for connections (28 retries left). 2026-02-05 18:31:41,828 p=63900 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] *** 2026-02-05 18:31:41,828 p=63900 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:31:44,016 p=63900 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Provision the mysql database] *** 2026-02-05 18:31:44,016 p=63900 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:31:44,890 p=63900 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Add dummy data into mysql-data1 pvc] *** 2026-02-05 18:31:44,891 p=63900 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:31:45,527 p=63900 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Create md5 hashes for the files] *** 2026-02-05 18:31:45,527 p=63900 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:31:45,549 p=63900 u=1001930000 n=ansible INFO| Pausing for 30 seconds 2026-02-05 18:32:15,553 p=63900 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Pause After Create md5 hashes for the files] *** 2026-02-05 18:32:15,553 p=63900 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:32:15,682 p=63900 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:32:15,683 p=63900 u=1001930000 n=ansible INFO| localhost : ok=27 changed=11 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 STEP: Verify Application deployment @ 02/05/26 18:32:15.743 2026/02/05 18:32:15 Using admin kubeconfig for with_validate operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check mysql pod status] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Query the inserted data] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Validate test1 file has correct md5 hash] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=19  changed=7  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026/02/05 18:32:22 2026-02-05 18:32:17,418 p=64489 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:32:17,419 p=64489 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:32:17,736 p=64489 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:32:17,736 p=64489 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:32:18,051 p=64489 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:32:18,051 p=64489 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:32:18,364 p=64489 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:32:18,364 p=64489 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:32:18,383 p=64489 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:32:18,383 p=64489 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:32:18,383 p=64489 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:32:18,403 p=64489 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:32:18,403 p=64489 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:32:18,418 p=64489 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:32:18,418 p=64489 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:32:18,830 p=64489 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:32:18,830 p=64489 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:32:18,831 p=64489 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:32:18,831 p=64489 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:32:18,859 p=64489 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:32:18,859 p=64489 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:32:18,881 p=64489 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:32:18,881 p=64489 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:32:18,884 p=64489 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:32:19,492 p=64489 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:32:19,493 p=64489 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:32:20,857 p=64489 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check mysql pod status] *** 2026-02-05 18:32:20,858 p=64489 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:32:20,858 p=64489 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:32:20,858 p=64489 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:32:20,858 p=64489 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:32:20,858 p=64489 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:32:21,333 p=64489 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] *** 2026-02-05 18:32:21,333 p=64489 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:32:21,798 p=64489 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Query the inserted data] *** 2026-02-05 18:32:21,798 p=64489 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:32:22,440 p=64489 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Validate test1 file has correct md5 hash] *** 2026-02-05 18:32:22,440 p=64489 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:32:22,445 p=64489 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:32:22,445 p=64489 u=1001930000 n=ansible INFO| localhost : ok=19 changed=7 unreachable=0 failed=0 skipped=17 rescued=0 ignored=0 2026/02/05 18:32:22 {{ } { } [{{ } {mysql-data test-oadp-437-kopia 71a28809-831e-498a-8875-b714449e6a4c 189809 0 2026-02-05 18:31:11 +0000 UTC map[app:mysql testlabel:selectors testlabel2:foo] map[pv.kubernetes.io/bind-completed:yes pv.kubernetes.io/bound-by-controller:yes reclaimspace.csiaddons.openshift.io/cronjob:mysql-data-1770316272 reclaimspace.csiaddons.openshift.io/schedule:@weekly volume.beta.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com volume.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com] [] [kubernetes.io/pvc-protection] [{OpenAPI-Generator Update v1 2026-02-05 18:31:11 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:app":{},"f:testlabel":{},"f:testlabel2":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}} } {csi-addons-manager Update v1 2026-02-05 18:31:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:reclaimspace.csiaddons.openshift.io/cronjob":{},"f:reclaimspace.csiaddons.openshift.io/schedule":{}}}} } {kube-controller-manager Update v1 2026-02-05 18:31:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:pv.kubernetes.io/bind-completed":{},"f:pv.kubernetes.io/bound-by-controller":{},"f:volume.beta.kubernetes.io/storage-provisioner":{},"f:volume.kubernetes.io/storage-provisioner":{}}},"f:spec":{"f:volumeName":{}}} } {kube-controller-manager Update v1 2026-02-05 18:31:12 +0000 UTC FieldsV1 {"f:status":{"f:accessModes":{},"f:capacity":{".":{},"f:storage":{}},"f:phase":{}}} status}]} {[ReadWriteOnce] nil {map[] map[storage:{{2147483648 0} {} 2Gi BinarySI}]} pvc-71a28809-831e-498a-8875-b714449e6a4c 0xc001100900 0xc001100910 nil nil } {Bound [ReadWriteOnce] map[storage:{{2147483648 0} {} 2Gi BinarySI}] [] map[] map[] nil}} {{ } {mysql-data1 test-oadp-437-kopia 0732d7f1-b83b-463e-ad4b-4caae856a8ec 189831 0 2026-02-05 18:31:11 +0000 UTC map[app:mysql testlabel:selectors testlabel2:foo] map[pv.kubernetes.io/bind-completed:yes pv.kubernetes.io/bound-by-controller:yes reclaimspace.csiaddons.openshift.io/cronjob:mysql-data1-1770316272 reclaimspace.csiaddons.openshift.io/schedule:@weekly volume.beta.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com volume.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com] [] [kubernetes.io/pvc-protection] [{OpenAPI-Generator Update v1 2026-02-05 18:31:11 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:app":{},"f:testlabel":{},"f:testlabel2":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}} } {csi-addons-manager Update v1 2026-02-05 18:31:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:reclaimspace.csiaddons.openshift.io/cronjob":{},"f:reclaimspace.csiaddons.openshift.io/schedule":{}}}} } {kube-controller-manager Update v1 2026-02-05 18:31:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:pv.kubernetes.io/bind-completed":{},"f:pv.kubernetes.io/bound-by-controller":{},"f:volume.beta.kubernetes.io/storage-provisioner":{},"f:volume.kubernetes.io/storage-provisioner":{}}},"f:spec":{"f:volumeName":{}}} } {kube-controller-manager Update v1 2026-02-05 18:31:12 +0000 UTC FieldsV1 {"f:status":{"f:accessModes":{},"f:capacity":{".":{},"f:storage":{}},"f:phase":{}}} status}]} {[ReadWriteOnce] nil {map[] map[storage:{{2147483648 0} {} 2Gi BinarySI}]} pvc-0732d7f1-b83b-463e-ad4b-4caae856a8ec 0xc001100a70 0xc001100a80 nil nil } {Bound [ReadWriteOnce] map[storage:{{2147483648 0} {} 2Gi BinarySI}] [] map[] map[] nil}}]} STEP: Creating backup mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8 @ 02/05/26 18:32:22.509 2026/02/05 18:32:22 Wait until backup mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8 is completed backup phase: Completed 2026/02/05 18:32:42 Verify the PodVolumeBackup is completed successfully and BackupRepository type is matching with DPA.nodeAgent.uploaderType 2026/02/05 18:32:42 apiVersion: velero.io/v1 kind: PodVolumeBackup metadata: annotations: velero.io/pvc-name: mysql-data creationTimestamp: "2026-02-05T18:32:25Z" generateName: mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8- generation: 5 labels: velero.io/backup-name: mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8 velero.io/backup-uid: 7227a2dc-eec8-41c1-b990-fb394cdb96eb velero.io/pvc-uid: 71a28809-831e-498a-8875-b714449e6a4c managedFields: - apiVersion: velero.io/v1 fieldsType: FieldsV1 fieldsV1: f:metadata: f:annotations: .: {} f:velero.io/pvc-name: {} f:generateName: {} f:labels: .: {} f:velero.io/backup-name: {} f:velero.io/backup-uid: {} f:velero.io/pvc-uid: {} f:ownerReferences: .: {} k:{"uid":"7227a2dc-eec8-41c1-b990-fb394cdb96eb"}: {} f:spec: .: {} f:backupStorageLocation: {} f:node: {} f:pod: {} f:repoIdentifier: {} f:tags: .: {} f:backup: {} f:backup-uid: {} f:ns: {} f:pod: {} f:pod-uid: {} f:pvc-uid: {} f:volume: {} f:uploaderType: {} f:volume: {} f:status: .: {} f:progress: {} manager: velero-server operation: Update time: "2026-02-05T18:32:25Z" - apiVersion: velero.io/v1 fieldsType: FieldsV1 fieldsV1: f:status: f:completionTimestamp: {} f:path: {} f:phase: {} f:progress: f:bytesDone: {} f:totalBytes: {} f:snapshotID: {} f:startTimestamp: {} manager: node-agent-server operation: Update time: "2026-02-05T18:32:27Z" name: mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8-dzw5l namespace: openshift-adp ownerReferences: - apiVersion: velero.io/v1 controller: true kind: Backup name: mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8 uid: 7227a2dc-eec8-41c1-b990-fb394cdb96eb resourceVersion: "190939" uid: 8ead9ba5-6528-4b4a-b1fc-53205c80cb91 spec: backupStorageLocation: ts-dpa-1 node: ip-10-0-60-83.us-east-2.compute.internal pod: kind: Pod name: mysql-86ffb49df-r65zj namespace: test-oadp-437-kopia uid: 795de1c5-2fbc-4fe2-be3c-7b5c377bb50d repoIdentifier: "" tags: backup: mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8 backup-uid: 7227a2dc-eec8-41c1-b990-fb394cdb96eb ns: test-oadp-437-kopia pod: mysql-86ffb49df-r65zj pod-uid: 795de1c5-2fbc-4fe2-be3c-7b5c377bb50d pvc-uid: 71a28809-831e-498a-8875-b714449e6a4c volume: mysql-data uploaderType: kopia volume: mysql-data status: completionTimestamp: "2026-02-05T18:32:27Z" path: /host_pods/795de1c5-2fbc-4fe2-be3c-7b5c377bb50d/volumes/kubernetes.io~csi/pvc-71a28809-831e-498a-8875-b714449e6a4c/mount phase: Completed progress: bytesDone: 107854713 totalBytes: 107854713 snapshotID: 8f84d8b14075883a974d5612b546be58 startTimestamp: "2026-02-05T18:32:25Z" 2026/02/05 18:32:42 apiVersion: velero.io/v1 kind: PodVolumeBackup metadata: annotations: velero.io/pvc-name: mysql-data1 creationTimestamp: "2026-02-05T18:32:25Z" generateName: mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8- generation: 5 labels: velero.io/backup-name: mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8 velero.io/backup-uid: 7227a2dc-eec8-41c1-b990-fb394cdb96eb velero.io/pvc-uid: 0732d7f1-b83b-463e-ad4b-4caae856a8ec managedFields: - apiVersion: velero.io/v1 fieldsType: FieldsV1 fieldsV1: f:metadata: f:annotations: .: {} f:velero.io/pvc-name: {} f:generateName: {} f:labels: .: {} f:velero.io/backup-name: {} f:velero.io/backup-uid: {} f:velero.io/pvc-uid: {} f:ownerReferences: .: {} k:{"uid":"7227a2dc-eec8-41c1-b990-fb394cdb96eb"}: {} f:spec: .: {} f:backupStorageLocation: {} f:node: {} f:pod: {} f:repoIdentifier: {} f:tags: .: {} f:backup: {} f:backup-uid: {} f:ns: {} f:pod: {} f:pod-uid: {} f:pvc-uid: {} f:volume: {} f:uploaderType: {} f:volume: {} f:status: .: {} f:progress: {} manager: velero-server operation: Update time: "2026-02-05T18:32:25Z" - apiVersion: velero.io/v1 fieldsType: FieldsV1 fieldsV1: f:status: f:completionTimestamp: {} f:path: {} f:phase: {} f:progress: f:bytesDone: {} f:totalBytes: {} f:snapshotID: {} f:startTimestamp: {} manager: node-agent-server operation: Update time: "2026-02-05T18:32:34Z" name: mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8-v67kc namespace: openshift-adp ownerReferences: - apiVersion: velero.io/v1 controller: true kind: Backup name: mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8 uid: 7227a2dc-eec8-41c1-b990-fb394cdb96eb resourceVersion: "191043" uid: 9812c246-46dc-4b53-983f-5da8e2a08b85 spec: backupStorageLocation: ts-dpa-1 node: ip-10-0-60-83.us-east-2.compute.internal pod: kind: Pod name: mysql-86ffb49df-r65zj namespace: test-oadp-437-kopia uid: 795de1c5-2fbc-4fe2-be3c-7b5c377bb50d repoIdentifier: "" tags: backup: mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8 backup-uid: 7227a2dc-eec8-41c1-b990-fb394cdb96eb ns: test-oadp-437-kopia pod: mysql-86ffb49df-r65zj pod-uid: 795de1c5-2fbc-4fe2-be3c-7b5c377bb50d pvc-uid: 0732d7f1-b83b-463e-ad4b-4caae856a8ec volume: mysql-data1 uploaderType: kopia volume: mysql-data1 status: completionTimestamp: "2026-02-05T18:32:34Z" path: /host_pods/795de1c5-2fbc-4fe2-be3c-7b5c377bb50d/volumes/kubernetes.io~csi/pvc-0732d7f1-b83b-463e-ad4b-4caae856a8ec/mount phase: Completed progress: bytesDone: 104857640 totalBytes: 104857640 snapshotID: 98cb031cccff5e961648dbf2fe23fa25 startTimestamp: "2026-02-05T18:32:31Z" STEP: Verify backup mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8 has completed successfully @ 02/05/26 18:32:42.549 2026/02/05 18:32:42 Backup for case mysql succeeded STEP: Delete the appplication resources mysql @ 02/05/26 18:32:42.593 STEP: Cleanup Application for case mysql @ 02/05/26 18:32:42.593 2026/02/05 18:32:42 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Remove namespace test-oadp-437-kopia] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=16  changed=5  unreachable=0 failed=0 skipped=20  rescued=0 ignored=0 2026/02/05 18:33:13 2026-02-05 18:32:44,274 p=64814 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:32:44,274 p=64814 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:32:44,596 p=64814 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:32:44,596 p=64814 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:32:44,940 p=64814 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:32:44,940 p=64814 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:32:45,280 p=64814 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:32:45,280 p=64814 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:32:45,301 p=64814 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:32:45,301 p=64814 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:32:45,301 p=64814 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:32:45,323 p=64814 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:32:45,323 p=64814 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:32:45,339 p=64814 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:32:45,340 p=64814 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:32:45,786 p=64814 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:32:45,787 p=64814 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:32:45,787 p=64814 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:32:45,787 p=64814 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:32:45,814 p=64814 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:32:45,814 p=64814 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:32:45,834 p=64814 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:32:45,834 p=64814 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:32:45,837 p=64814 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:32:46,433 p=64814 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:32:46,433 p=64814 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:33:12,625 p=64814 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Remove namespace test-oadp-437-kopia] *** 2026-02-05 18:33:12,626 p=64814 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:33:12,626 p=64814 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:33:12,626 p=64814 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:33:12,626 p=64814 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:33:12,626 p=64814 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:33:12,976 p=64814 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:33:12,977 p=64814 u=1001930000 n=ansible INFO| localhost : ok=16 changed=5 unreachable=0 failed=0 skipped=20 rescued=0 ignored=0 2026/02/05 18:33:13 Creating restore mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8 for case mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8 STEP: Create restore mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8 from backup mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8 @ 02/05/26 18:33:13.032 2026/02/05 18:33:13 Wait until restore mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8 is complete restore phase: InProgress restore phase: InProgress restore phase: Completed 2026/02/05 18:33:43 Verify the PodVolumeBackup and PodVolumeRestore count is equal 2026/02/05 18:33:43 Verify the PodVolumeRestore is completed sucessfully and uploaderType is matching 2026/02/05 18:33:43 apiVersion: velero.io/v1 kind: PodVolumeRestore metadata: creationTimestamp: "2026-02-05T18:33:15Z" generateName: mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8- generation: 4 labels: velero.io/pod-uid: 78d417de-ab3c-423f-8a96-278c44805e5e velero.io/pvc-uid: 0c7b14e3-4f1a-4f79-9996-aa7e94ca30d3 velero.io/restore-name: mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8 velero.io/restore-uid: a5e31597-6347-465b-b947-a79b0263915d managedFields: - apiVersion: velero.io/v1 fieldsType: FieldsV1 fieldsV1: f:metadata: f:generateName: {} f:labels: .: {} f:velero.io/pod-uid: {} f:velero.io/pvc-uid: {} f:velero.io/restore-name: {} f:velero.io/restore-uid: {} f:ownerReferences: .: {} k:{"uid":"a5e31597-6347-465b-b947-a79b0263915d"}: {} f:spec: .: {} f:backupStorageLocation: {} f:pod: {} f:repoIdentifier: {} f:snapshotID: {} f:sourceNamespace: {} f:uploaderType: {} f:volume: {} f:status: .: {} f:progress: {} manager: velero-server operation: Update time: "2026-02-05T18:33:15Z" - apiVersion: velero.io/v1 fieldsType: FieldsV1 fieldsV1: f:status: f:completionTimestamp: {} f:phase: {} f:progress: f:bytesDone: {} f:totalBytes: {} f:startTimestamp: {} manager: node-agent-server operation: Update time: "2026-02-05T18:33:35Z" name: mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8-f4dzm namespace: openshift-adp ownerReferences: - apiVersion: velero.io/v1 controller: true kind: Restore name: mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8 uid: a5e31597-6347-465b-b947-a79b0263915d resourceVersion: "192143" uid: 69268fa1-a7e0-4887-8db8-ac1e68a8eddc spec: backupStorageLocation: ts-dpa-1 pod: kind: Pod name: mysql-86ffb49df-r65zj namespace: test-oadp-437-kopia uid: 78d417de-ab3c-423f-8a96-278c44805e5e repoIdentifier: "" snapshotID: 98cb031cccff5e961648dbf2fe23fa25 sourceNamespace: test-oadp-437-kopia uploaderType: kopia volume: mysql-data1 status: completionTimestamp: "2026-02-05T18:33:35Z" phase: Completed progress: bytesDone: 104857640 totalBytes: 104857640 startTimestamp: "2026-02-05T18:33:32Z" 2026/02/05 18:33:43 apiVersion: velero.io/v1 kind: PodVolumeRestore metadata: creationTimestamp: "2026-02-05T18:33:15Z" generateName: mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8- generation: 4 labels: velero.io/pod-uid: 78d417de-ab3c-423f-8a96-278c44805e5e velero.io/pvc-uid: a8133aa6-0c4b-4827-8030-f2d2ff6baace velero.io/restore-name: mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8 velero.io/restore-uid: a5e31597-6347-465b-b947-a79b0263915d managedFields: - apiVersion: velero.io/v1 fieldsType: FieldsV1 fieldsV1: f:metadata: f:generateName: {} f:labels: .: {} f:velero.io/pod-uid: {} f:velero.io/pvc-uid: {} f:velero.io/restore-name: {} f:velero.io/restore-uid: {} f:ownerReferences: .: {} k:{"uid":"a5e31597-6347-465b-b947-a79b0263915d"}: {} f:spec: .: {} f:backupStorageLocation: {} f:pod: {} f:repoIdentifier: {} f:snapshotID: {} f:sourceNamespace: {} f:uploaderType: {} f:volume: {} f:status: .: {} f:progress: {} manager: velero-server operation: Update time: "2026-02-05T18:33:15Z" - apiVersion: velero.io/v1 fieldsType: FieldsV1 fieldsV1: f:status: f:completionTimestamp: {} f:phase: {} f:progress: f:bytesDone: {} f:totalBytes: {} f:startTimestamp: {} manager: node-agent-server operation: Update time: "2026-02-05T18:33:28Z" name: mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8-vzngd namespace: openshift-adp ownerReferences: - apiVersion: velero.io/v1 controller: true kind: Restore name: mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8 uid: a5e31597-6347-465b-b947-a79b0263915d resourceVersion: "192035" uid: 23fdcfda-4c9a-4eac-bde4-6a697682743b spec: backupStorageLocation: ts-dpa-1 pod: kind: Pod name: mysql-86ffb49df-r65zj namespace: test-oadp-437-kopia uid: 78d417de-ab3c-423f-8a96-278c44805e5e repoIdentifier: "" snapshotID: 8f84d8b14075883a974d5612b546be58 sourceNamespace: test-oadp-437-kopia uploaderType: kopia volume: mysql-data status: completionTimestamp: "2026-02-05T18:33:28Z" phase: Completed progress: bytesDone: 107854713 totalBytes: 107854713 startTimestamp: "2026-02-05T18:33:26Z" STEP: Verify restore mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8has completed successfully @ 02/05/26 18:33:43.096 STEP: Verify Application restore @ 02/05/26 18:33:43.101 STEP: Verify Application deployment for case mysql @ 02/05/26 18:33:43.101 2026/02/05 18:33:43 Using admin kubeconfig for with_validate operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check mysql pod status] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Query the inserted data] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Validate test1 file has correct md5 hash] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=19  changed=7  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026/02/05 18:33:49 2026-02-05 18:33:44,771 p=65041 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:33:44,771 p=65041 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:33:45,079 p=65041 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:33:45,079 p=65041 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:33:45,384 p=65041 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:33:45,384 p=65041 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:33:45,693 p=65041 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:33:45,694 p=65041 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:33:45,712 p=65041 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:33:45,712 p=65041 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:33:45,712 p=65041 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:33:45,732 p=65041 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:33:45,732 p=65041 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:33:45,746 p=65041 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:33:45,746 p=65041 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:33:46,156 p=65041 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:33:46,157 p=65041 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:33:46,157 p=65041 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:33:46,157 p=65041 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:33:46,185 p=65041 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:33:46,185 p=65041 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:33:46,206 p=65041 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:33:46,206 p=65041 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:33:46,209 p=65041 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:33:46,807 p=65041 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:33:46,807 p=65041 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:33:48,144 p=65041 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check mysql pod status] *** 2026-02-05 18:33:48,144 p=65041 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:33:48,145 p=65041 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:33:48,145 p=65041 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:33:48,145 p=65041 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:33:48,145 p=65041 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:33:48,602 p=65041 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] *** 2026-02-05 18:33:48,602 p=65041 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:33:49,060 p=65041 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Query the inserted data] *** 2026-02-05 18:33:49,060 p=65041 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:33:49,715 p=65041 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Validate test1 file has correct md5 hash] *** 2026-02-05 18:33:49,715 p=65041 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:33:49,720 p=65041 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:33:49,720 p=65041 u=1001930000 n=ansible INFO| localhost : ok=19 changed=7 unreachable=0 failed=0 skipped=17 rescued=0 ignored=0 < Exit [It] [tc-id:OADP-437][interop][smoke] [Tier0] [vf:fsb-kopia] MySQL application with filesystem, Kopia @ 02/05/26 18:33:49.776 (2m50.524s) > Enter [JustAfterEach] TOP-LEVEL @ 02/05/26 18:33:49.776 2026/02/05 18:33:49 Using Must-gather image: registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 Secret deletion flag: true Deleting cloud credentials secret cloud-credentials in namespace openshift-adp < Exit [JustAfterEach] TOP-LEVEL @ 02/05/26 18:33:49.785 (9ms) > Enter [DeferCleanup (Each)] Application backup @ 02/05/26 18:33:49.785 < Exit [DeferCleanup (Each)] Application backup @ 02/05/26 18:33:49.789 (4ms) > Enter [DeferCleanup (Each)] Application backup @ 02/05/26 18:33:49.789 < Exit [DeferCleanup (Each)] Application backup @ 02/05/26 18:33:49.789 (0s) > Enter [DeferCleanup (Each)] Application backup @ 02/05/26 18:33:49.789 2026/02/05 18:33:49 Cleaning app 2026/02/05 18:33:49 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Remove namespace test-oadp-437-kopia] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=16  changed=5  unreachable=0 failed=0 skipped=20  rescued=0 ignored=0 2026/02/05 18:34:20 2026-02-05 18:33:51,470 p=65368 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:33:51,470 p=65368 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:33:51,786 p=65368 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:33:51,786 p=65368 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:33:52,099 p=65368 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:33:52,099 p=65368 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:33:52,408 p=65368 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:33:52,408 p=65368 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:33:52,426 p=65368 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:33:52,426 p=65368 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:33:52,427 p=65368 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:33:52,446 p=65368 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:33:52,446 p=65368 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:33:52,460 p=65368 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:33:52,460 p=65368 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:33:52,886 p=65368 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:33:52,886 p=65368 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:33:52,886 p=65368 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:33:52,887 p=65368 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:33:52,915 p=65368 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:33:52,915 p=65368 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:33:52,936 p=65368 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:33:52,936 p=65368 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:33:52,939 p=65368 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:33:53,537 p=65368 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:33:53,538 p=65368 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:34:19,700 p=65368 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Remove namespace test-oadp-437-kopia] *** 2026-02-05 18:34:19,701 p=65368 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:34:19,701 p=65368 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:34:19,701 p=65368 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:34:19,702 p=65368 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:34:19,702 p=65368 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:34:20,056 p=65368 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:34:20,056 p=65368 u=1001930000 n=ansible INFO| localhost : ok=16 changed=5 unreachable=0 failed=0 skipped=20 rescued=0 ignored=0 < Exit [DeferCleanup (Each)] Application backup @ 02/05/26 18:34:20.112 (30.323s) > Enter [DeferCleanup (Each)] Application backup @ 02/05/26 18:34:20.112 2026/02/05 18:34:20 Cleaning setup resources for the backup < Exit [DeferCleanup (Each)] Application backup @ 02/05/26 18:34:20.112 (0s) > Enter [DeferCleanup (Each)] Application backup @ 02/05/26 18:34:20.112 2026/02/05 18:34:20 Deleting DPA CR < Exit [DeferCleanup (Each)] Application backup @ 02/05/26 18:34:20.125 (13ms) • [200.880 seconds] ------------------------------ S ------------------------------ Backup restore tests Application backup [tc-id:OADP-122] [interop] [skip-disconnected] [Tier0] [vf:csi-snapshots] Django application with BSL&CSI [exclude_aro-4] /alabama/cspi/e2e/app_backup/backup_restore.go:93 > Enter [BeforeEach] TOP-LEVEL @ 02/05/26 18:34:20.126 < Exit [BeforeEach] TOP-LEVEL @ 02/05/26 18:34:20.126 (0s) > Enter [BeforeEach] Backup restore tests @ 02/05/26 18:34:20.126 < Exit [BeforeEach] Backup restore tests @ 02/05/26 18:34:20.136 (10ms) > Enter [JustBeforeEach] TOP-LEVEL @ 02/05/26 18:34:20.136 < Exit [JustBeforeEach] TOP-LEVEL @ 02/05/26 18:34:20.136 (0s) > Enter [It] [tc-id:OADP-122] [interop] [skip-disconnected] [Tier0] [vf:csi-snapshots] Django application with BSL&CSI @ 02/05/26 18:34:20.136 2026/02/05 18:34:20 Delete all downloadrequest No download requests are found STEP: Create DPA CR @ 02/05/26 18:34:20.142 2026/02/05 18:34:20 csi 2026/02/05 18:34:20 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "d0ae9506-9289-4bbd-aa5b-48797efc69ef", "resourceVersion": "192887", "generation": 1, "creationTimestamp": "2026-02-05T18:34:20Z", "managedFields": [ { "manager": "e2e.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T18:34:20Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false } }, "features": null, "logFormat": "text" }, "status": {} } Delete all the backups that remained in the phase InProgress Deleting backup CRs in progress Deletion of backup CRs in progress completed Delete all the restores that remained in the phase InProgress Deleting restore CRs in progress Deletion of restore CRs in progress completed STEP: Verify DPA CR setup @ 02/05/26 18:34:20.193 2026/02/05 18:34:20 Waiting for velero pod to be running 2026/02/05 18:34:20 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete' 2026/02/05 18:34:20 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "d0ae9506-9289-4bbd-aa5b-48797efc69ef", "resourceVersion": "192887", "generation": 1, "creationTimestamp": "2026-02-05T18:34:20Z", "managedFields": [ { "manager": "e2e.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T18:34:20Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false } }, "features": null, "logFormat": "text" }, "status": {} } 2026/02/05 18:34:25 DPA successfully reconciled STEP: Prepare backup resources, depending on the volumes backup type @ 02/05/26 18:34:25.233 Run the command: oc get ns openshift-storage &> /dev/null && echo true || echo false 2026/02/05 18:34:25 The 'openshift-storage' namespace exists 2026/02/05 18:34:25 Checking default storage class count 2026/02/05 18:34:25 Using the CSI driver: openshift-storage.rbd.csi.ceph.com 2026/02/05 18:34:25 Snapclass 'example-snapclass' doesn't exist, creating 2026/02/05 18:34:25 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 18:34:25 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd STEP: Installing application for case django-persistent @ 02/05/26 18:34:25.456 2026/02/05 18:34:25 🔄 [Attempt 1/3] Executing operation: Deploy application ocp-django 2026/02/05 18:34:25 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Check namespace test-oadp-122] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Create namespace test-oadp-122] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Create the mtc test django psql persistent template] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Create openshift django psql persistent application from openshift templates] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=19  changed=7  unreachable=0 failed=0 skipped=19  rescued=0 ignored=0 2026/02/05 18:34:32 2026-02-05 18:34:27,137 p=65620 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:34:27,137 p=65620 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:34:27,447 p=65620 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:34:27,448 p=65620 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:34:27,759 p=65620 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:34:27,759 p=65620 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:34:28,074 p=65620 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:34:28,074 p=65620 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:34:28,092 p=65620 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:34:28,092 p=65620 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:34:28,092 p=65620 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:34:28,112 p=65620 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:34:28,112 p=65620 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:34:28,126 p=65620 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:34:28,127 p=65620 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:34:28,545 p=65620 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:34:28,545 p=65620 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:34:28,545 p=65620 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:34:28,546 p=65620 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:34:28,574 p=65620 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:34:28,574 p=65620 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:34:28,595 p=65620 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:34:28,596 p=65620 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:34:28,598 p=65620 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:34:29,196 p=65620 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:34:29,196 p=65620 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:34:30,283 p=65620 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Check namespace test-oadp-122] *** 2026-02-05 18:34:30,284 p=65620 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:34:30,284 p=65620 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:34:30,284 p=65620 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:34:30,285 p=65620 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:34:30,285 p=65620 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:34:30,716 p=65620 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Create namespace test-oadp-122] *** 2026-02-05 18:34:30,717 p=65620 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:34:31,916 p=65620 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Create the mtc test django psql persistent template] *** 2026-02-05 18:34:31,916 p=65620 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:34:32,464 p=65620 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Create openshift django psql persistent application from openshift templates] *** 2026-02-05 18:34:32,465 p=65620 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:34:32,761 p=65620 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:34:32,761 p=65620 u=1001930000 n=ansible INFO| localhost : ok=19 changed=7 unreachable=0 failed=0 skipped=19 rescued=0 ignored=0 STEP: Verify Application deployment @ 02/05/26 18:34:32.816 2026/02/05 18:34:32 Using admin kubeconfig for with_validate operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Get the latest build name] *** changed: [localhost] FAILED - RETRYING: [localhost]: Wait for build to complete successfully (60 retries left). FAILED - RETRYING: [localhost]: Wait for build to complete successfully (59 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Wait for build to complete successfully] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Display build completion status] *** ok: [localhost] => {  "msg": "Build django-psql-persistent-1 completed successfully" } [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Check postgresql pod status] *** ok: [localhost] FAILED - RETRYING: [localhost]: Check application pod status (30 retries left). FAILED - RETRYING: [localhost]: Check application pod status (29 retries left). FAILED - RETRYING: [localhost]: Check application pod status (28 retries left). FAILED - RETRYING: [localhost]: Check application pod status (27 retries left). FAILED - RETRYING: [localhost]: Check application pod status (26 retries left). FAILED - RETRYING: [localhost]: Check application pod status (25 retries left). FAILED - RETRYING: [localhost]: Check application pod status (24 retries left). FAILED - RETRYING: [localhost]: Check application pod status (23 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Check application pod status] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Get route] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Access the html file] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : set_fact] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Get num visits up to now] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Print num of visits] *** ok: [localhost] => {  "msg": "PASS: # of visits should be 1; actual 1" } PLAY RECAP ********************************************************************* localhost : ok=25  changed=6  unreachable=0 failed=0 skipped=13  rescued=0 ignored=0 2026/02/05 18:37:09 2026-02-05 18:34:34,505 p=65930 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:34:34,505 p=65930 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:34:34,813 p=65930 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:34:34,813 p=65930 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:34:35,120 p=65930 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:34:35,121 p=65930 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:34:35,432 p=65930 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:34:35,432 p=65930 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:34:35,450 p=65930 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:34:35,450 p=65930 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:34:35,450 p=65930 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:34:35,469 p=65930 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:34:35,470 p=65930 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:34:35,484 p=65930 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:34:35,484 p=65930 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:34:35,898 p=65930 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:34:35,899 p=65930 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:34:35,899 p=65930 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:34:35,899 p=65930 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:34:35,926 p=65930 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:34:35,927 p=65930 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:34:35,947 p=65930 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:34:35,947 p=65930 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:34:35,950 p=65930 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:34:36,555 p=65930 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:34:36,555 p=65930 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:34:37,013 p=65930 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Get the latest build name] *** 2026-02-05 18:34:37,013 p=65930 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:34:37,361 p=65930 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for build to complete successfully (60 retries left). 2026-02-05 18:35:07,700 p=65930 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for build to complete successfully (59 retries left). 2026-02-05 18:35:38,032 p=65930 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Wait for build to complete successfully] *** 2026-02-05 18:35:38,032 p=65930 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:35:38,055 p=65930 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Display build completion status] *** 2026-02-05 18:35:38,055 p=65930 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Build django-psql-persistent-1 completed successfully" } 2026-02-05 18:35:39,162 p=65930 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Check postgresql pod status] *** 2026-02-05 18:35:39,163 p=65930 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:35:39,163 p=65930 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:35:39,163 p=65930 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:35:39,163 p=65930 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:35:39,163 p=65930 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:35:40,099 p=65930 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check application pod status (30 retries left). 2026-02-05 18:35:50,985 p=65930 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check application pod status (29 retries left). 2026-02-05 18:36:01,868 p=65930 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check application pod status (28 retries left). 2026-02-05 18:36:12,778 p=65930 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check application pod status (27 retries left). 2026-02-05 18:36:23,676 p=65930 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check application pod status (26 retries left). 2026-02-05 18:36:34,575 p=65930 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check application pod status (25 retries left). 2026-02-05 18:36:45,510 p=65930 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check application pod status (24 retries left). 2026-02-05 18:36:56,409 p=65930 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check application pod status (23 retries left). 2026-02-05 18:37:07,295 p=65930 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Check application pod status] *** 2026-02-05 18:37:07,295 p=65930 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:37:08,559 p=65930 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Get route] *** 2026-02-05 18:37:08,560 p=65930 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:37:09,059 p=65930 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Access the html file] *** 2026-02-05 18:37:09,059 p=65930 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:37:09,085 p=65930 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : set_fact] *** 2026-02-05 18:37:09,085 p=65930 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:37:09,467 p=65930 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Get num visits up to now] *** 2026-02-05 18:37:09,467 p=65930 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:37:09,510 p=65930 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Print num of visits] *** 2026-02-05 18:37:09,511 p=65930 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "PASS: # of visits should be 1; actual 1" } 2026-02-05 18:37:09,515 p=65930 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:37:09,515 p=65930 u=1001930000 n=ansible INFO| localhost : ok=25 changed=6 unreachable=0 failed=0 skipped=13 rescued=0 ignored=0 2026/02/05 18:37:09 {{ } { } [{{ } {postgresql test-oadp-122 193f7b67-3081-471a-8897-a34961714fdd 193259 0 2026-02-05 18:34:32 +0000 UTC map[app:django-psql-persistent template:django-psql-persistent] map[openshift.io/generated-by:OpenShiftNewApp pv.kubernetes.io/bind-completed:yes pv.kubernetes.io/bound-by-controller:yes reclaimspace.csiaddons.openshift.io/cronjob:postgresql-1770316472 reclaimspace.csiaddons.openshift.io/schedule:@weekly volume.beta.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com volume.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com] [] [kubernetes.io/pvc-protection] [{csi-addons-manager Update v1 2026-02-05 18:34:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:reclaimspace.csiaddons.openshift.io/cronjob":{},"f:reclaimspace.csiaddons.openshift.io/schedule":{}}}} } {kube-controller-manager Update v1 2026-02-05 18:34:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:pv.kubernetes.io/bind-completed":{},"f:pv.kubernetes.io/bound-by-controller":{},"f:volume.beta.kubernetes.io/storage-provisioner":{},"f:volume.kubernetes.io/storage-provisioner":{}}},"f:spec":{"f:volumeName":{}}} } {kube-controller-manager Update v1 2026-02-05 18:34:32 +0000 UTC FieldsV1 {"f:status":{"f:accessModes":{},"f:capacity":{".":{},"f:storage":{}},"f:phase":{}}} status} {oc Update v1 2026-02-05 18:34:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:openshift.io/generated-by":{}},"f:labels":{".":{},"f:app":{},"f:template":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}} }]} {[ReadWriteOnce] nil {map[] map[storage:{{1073741824 0} {} 1Gi BinarySI}]} pvc-193f7b67-3081-471a-8897-a34961714fdd 0xc000be4f00 0xc000be4f10 nil nil } {Bound [ReadWriteOnce] map[storage:{{1073741824 0} {} 1Gi BinarySI}] [] map[] map[] nil}}]} STEP: Creating backup django-persistent-48f83df5-02c1-11f1-a139-0a58ac1896e8 @ 02/05/26 18:37:09.59 2026/02/05 18:37:09 Wait until backup django-persistent-48f83df5-02c1-11f1-a139-0a58ac1896e8 is completed backup phase: Completed 2026/02/05 18:37:29 Verify the Backup has CSIVolumeSnapshotsAttempted and CSIVolumeSnapshotsCompleted field on status 2026/02/05 18:37:29 Run velero describe on the backup 2026/02/05 18:37:29 [./velero describe backup django-persistent-48f83df5-02c1-11f1-a139-0a58ac1896e8 -n openshift-adp --details --insecure-skip-tls-verify] 2026/02/05 18:37:30 Exec stderr: "" 2026/02/05 18:37:30 Name: django-persistent-48f83df5-02c1-11f1-a139-0a58ac1896e8 Namespace: openshift-adp Labels: velero.io/storage-location=ts-dpa-1 Annotations: velero.io/resource-timeout=10m0s velero.io/source-cluster-k8s-gitversion=v1.34.2 velero.io/source-cluster-k8s-major-version=1 velero.io/source-cluster-k8s-minor-version=34 Phase: Completed Namespaces: Included: test-oadp-122 Excluded: Resources: Included: * Excluded: Cluster-scoped: auto Label selector: Or label selector: Storage Location: ts-dpa-1 Velero-Native Snapshot PVs: auto File System Backup (Default): false Snapshot Move Data: false Data Mover: velero TTL: 720h0m0s CSISnapshotTimeout: 10m0s ItemOperationTimeout: 4h0m0s Hooks: Backup Format Version: 1.1.0 Started: 2026-02-05 18:37:09 +0000 UTC Completed: 2026-02-05 18:37:24 +0000 UTC Expiration: 2026-03-07 18:37:09 +0000 UTC Total items to be backed up: 97 Items backed up: 97 Backup Item Operations: Operation for volumesnapshots.snapshot.storage.k8s.io test-oadp-122/velero-postgresql-44xc8: Backup Item Action Plugin: velero.io/csi-volumesnapshot-backupper Operation ID: test-oadp-122/velero-postgresql-44xc8/2026-02-05T18:37:16Z Items to Update: volumesnapshots.snapshot.storage.k8s.io test-oadp-122/velero-postgresql-44xc8 volumesnapshotcontents.snapshot.storage.k8s.io /snapcontent-4ae24134-29fd-4387-a8ba-e0dd5bc41b9a Phase: Completed Created: 2026-02-05 18:37:16 +0000 UTC Started: 2026-02-05 18:37:16 +0000 UTC Updated: 2026-02-05 18:37:23 +0000 UTC Resource List: apiextensions.k8s.io/v1/CustomResourceDefinition: - reclaimspacecronjobs.csiaddons.openshift.io apps/v1/Deployment: - test-oadp-122/django-psql-persistent - test-oadp-122/postgresql apps/v1/ReplicaSet: - test-oadp-122/django-psql-persistent-5754cdc5f - test-oadp-122/django-psql-persistent-dfc9f774f - test-oadp-122/postgresql-fdbf4b484 authorization.openshift.io/v1/RoleBinding: - test-oadp-122/admin - test-oadp-122/system:deployers - test-oadp-122/system:image-builders - test-oadp-122/system:image-pullers build.openshift.io/v1/Build: - test-oadp-122/django-psql-persistent-1 build.openshift.io/v1/BuildConfig: - test-oadp-122/django-psql-persistent csiaddons.openshift.io/v1alpha1/ReclaimSpaceCronJob: - test-oadp-122/postgresql-1770316472 discovery.k8s.io/v1/EndpointSlice: - test-oadp-122/django-psql-persistent-nqrg7 - test-oadp-122/postgresql-m7ps4 image.openshift.io/v1/ImageStream: - test-oadp-122/django-psql-persistent image.openshift.io/v1/ImageStreamTag: - test-oadp-122/django-psql-persistent:latest image.openshift.io/v1/ImageTag: - test-oadp-122/django-psql-persistent:latest rbac.authorization.k8s.io/v1/RoleBinding: - test-oadp-122/admin - test-oadp-122/system:deployers - test-oadp-122/system:image-builders - test-oadp-122/system:image-pullers route.openshift.io/v1/Route: - test-oadp-122/django-psql-persistent snapshot.storage.k8s.io/v1/VolumeSnapshot: - test-oadp-122/velero-postgresql-44xc8 snapshot.storage.k8s.io/v1/VolumeSnapshotClass: - example-snapclass snapshot.storage.k8s.io/v1/VolumeSnapshotContent: - snapcontent-4ae24134-29fd-4387-a8ba-e0dd5bc41b9a template.openshift.io/v1/Template: - test-oadp-122/django-psql-persistent v1/ConfigMap: - test-oadp-122/django-psql-persistent-1-ca - test-oadp-122/django-psql-persistent-1-global-ca - test-oadp-122/django-psql-persistent-1-sys-config - test-oadp-122/kube-root-ca.crt - test-oadp-122/openshift-service-ca.crt v1/Endpoints: - test-oadp-122/django-psql-persistent - test-oadp-122/postgresql v1/Event: - test-oadp-122/django-psql-persistent-1-build.18916d73c9812321 - test-oadp-122/django-psql-persistent-1-build.18916d73f1562b95 - test-oadp-122/django-psql-persistent-1-build.18916d73f2eaa2a1 - test-oadp-122/django-psql-persistent-1-build.18916d74ad7b7d36 - test-oadp-122/django-psql-persistent-1-build.18916d74b6a82b5c - test-oadp-122/django-psql-persistent-1-build.18916d74b749c983 - test-oadp-122/django-psql-persistent-1-build.18916d74f197b39a - test-oadp-122/django-psql-persistent-1-build.18916d74fb0d1ac7 - test-oadp-122/django-psql-persistent-1-build.18916d74fb90d046 - test-oadp-122/django-psql-persistent-1-build.18916d752df6ab14 - test-oadp-122/django-psql-persistent-1-build.18916d7537ec97f7 - test-oadp-122/django-psql-persistent-1-build.18916d75388c7349 - test-oadp-122/django-psql-persistent-1.18916d74f32b8aa0 - test-oadp-122/django-psql-persistent-1.18916d7f904f9785 - test-oadp-122/django-psql-persistent-5754cdc5f.18916d73bd61615d - test-oadp-122/django-psql-persistent-5754cdc5f.18916d73bf70d9e3 - test-oadp-122/django-psql-persistent-5754cdc5f.18916d73c01c315a - test-oadp-122/django-psql-persistent-5754cdc5f.18916d73c0bc18e2 - test-oadp-122/django-psql-persistent-5754cdc5f.18916d73c1fecc1f - test-oadp-122/django-psql-persistent-5754cdc5f.18916d73c7579577 - test-oadp-122/django-psql-persistent-5754cdc5f.18916d73d18678df - test-oadp-122/django-psql-persistent-5754cdc5f.18916d73e53fd606 - test-oadp-122/django-psql-persistent-5754cdc5f.18916d740c0189b4 - test-oadp-122/django-psql-persistent-5754cdc5f.18916d7458e2649a - test-oadp-122/django-psql-persistent-dfc9f774f-cfpnn.18916d7f3372a3c6 - test-oadp-122/django-psql-persistent-dfc9f774f-cfpnn.18916d7f5c3c0e70 - test-oadp-122/django-psql-persistent-dfc9f774f-cfpnn.18916d7f5dcdd527 - test-oadp-122/django-psql-persistent-dfc9f774f-cfpnn.18916d8122040f6c - test-oadp-122/django-psql-persistent-dfc9f774f-cfpnn.18916d812668dc14 - test-oadp-122/django-psql-persistent-dfc9f774f-cfpnn.18916d8126e03a07 - test-oadp-122/django-psql-persistent-dfc9f774f.18916d7f32d9aad5 - test-oadp-122/django-psql-persistent.18916d73bc4f9d47 - test-oadp-122/django-psql-persistent.18916d7f2f5182f3 - test-oadp-122/django-psql-persistent.18916d7f31c42442 - test-oadp-122/postgresql-fdbf4b484-gmq4j.18916d73c0e7ec89 - test-oadp-122/postgresql-fdbf4b484-gmq4j.18916d73cc82884c - test-oadp-122/postgresql-fdbf4b484-gmq4j.18916d73ce328925 - test-oadp-122/postgresql-fdbf4b484-gmq4j.18916d73efb1567d - test-oadp-122/postgresql-fdbf4b484-gmq4j.18916d7500d3a55c - test-oadp-122/postgresql-fdbf4b484-gmq4j.18916d75043002d4 - test-oadp-122/postgresql-fdbf4b484-gmq4j.18916d7923a35e02 - test-oadp-122/postgresql-fdbf4b484-gmq4j.18916d792e36ed93 - test-oadp-122/postgresql-fdbf4b484-gmq4j.18916d793727b499 - test-oadp-122/postgresql-fdbf4b484.18916d73c0b9b985 - test-oadp-122/postgresql.18916d73bd02315f - test-oadp-122/postgresql.18916d73bd0d8808 - test-oadp-122/postgresql.18916d73bfa43478 - test-oadp-122/postgresql.18916d73cc7f3da6 v1/Namespace: - test-oadp-122 v1/PersistentVolume: - pvc-193f7b67-3081-471a-8897-a34961714fdd v1/PersistentVolumeClaim: - test-oadp-122/postgresql v1/Pod: - test-oadp-122/django-psql-persistent-1-build - test-oadp-122/django-psql-persistent-dfc9f774f-cfpnn - test-oadp-122/postgresql-fdbf4b484-gmq4j v1/Secret: - test-oadp-122/builder-dockercfg-9wgh5 - test-oadp-122/default-dockercfg-ttsg7 - test-oadp-122/deployer-dockercfg-5lg4r - test-oadp-122/django-psql-persistent v1/Service: - test-oadp-122/django-psql-persistent - test-oadp-122/postgresql v1/ServiceAccount: - test-oadp-122/builder - test-oadp-122/default - test-oadp-122/deployer Backup Volumes: Velero-Native Snapshots: CSI Snapshots: test-oadp-122/postgresql: Snapshot: Operation ID: test-oadp-122/velero-postgresql-44xc8/2026-02-05T18:37:16Z Snapshot Content Name: snapcontent-4ae24134-29fd-4387-a8ba-e0dd5bc41b9a Storage Snapshot ID: 0001-0011-openshift-storage-0000000000000003-a7d33ad0-e3cc-4b63-8854-4829b31af715 Snapshot Size (bytes): 1073741824 CSI Driver: openshift-storage.rbd.csi.ceph.com Result: succeeded Pod Volume Backups: HooksAttempted: 0 HooksFailed: 0 STEP: Verify backup django-persistent-48f83df5-02c1-11f1-a139-0a58ac1896e8 has completed successfully @ 02/05/26 18:37:30.25 2026/02/05 18:37:30 Backup for case django-persistent succeeded STEP: Delete the appplication resources django-persistent @ 02/05/26 18:37:30.309 STEP: Cleanup Application for case django-persistent @ 02/05/26 18:37:30.309 2026/02/05 18:37:30 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Remove namespace test-oadp-122] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=16  changed=5  unreachable=0 failed=0 skipped=22  rescued=0 ignored=0 2026/02/05 18:38:00 2026-02-05 18:37:31,992 p=66451 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:37:31,993 p=66451 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:37:32,300 p=66451 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:37:32,301 p=66451 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:37:32,612 p=66451 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:37:32,612 p=66451 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:37:32,917 p=66451 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:37:32,917 p=66451 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:37:32,934 p=66451 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:37:32,935 p=66451 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:37:32,935 p=66451 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:37:32,955 p=66451 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:37:32,955 p=66451 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:37:32,970 p=66451 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:37:32,971 p=66451 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:37:33,401 p=66451 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:37:33,401 p=66451 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:37:33,402 p=66451 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:37:33,402 p=66451 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:37:33,429 p=66451 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:37:33,429 p=66451 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:37:33,450 p=66451 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:37:33,450 p=66451 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:37:33,453 p=66451 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:37:34,050 p=66451 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:37:34,051 p=66451 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:38:00,247 p=66451 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Remove namespace test-oadp-122] *** 2026-02-05 18:38:00,247 p=66451 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:38:00,248 p=66451 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:38:00,248 p=66451 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:38:00,248 p=66451 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:38:00,248 p=66451 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:38:00,632 p=66451 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:38:00,632 p=66451 u=1001930000 n=ansible INFO| localhost : ok=16 changed=5 unreachable=0 failed=0 skipped=22 rescued=0 ignored=0 2026/02/05 18:38:00 Creating restore django-persistent-48f83df5-02c1-11f1-a139-0a58ac1896e8 for case django-persistent-48f83df5-02c1-11f1-a139-0a58ac1896e8 STEP: Create restore django-persistent-48f83df5-02c1-11f1-a139-0a58ac1896e8 from backup django-persistent-48f83df5-02c1-11f1-a139-0a58ac1896e8 @ 02/05/26 18:38:00.686 2026/02/05 18:38:00 Wait until restore django-persistent-48f83df5-02c1-11f1-a139-0a58ac1896e8 is complete restore phase: Finalizing restore phase: Completed STEP: Verify restore django-persistent-48f83df5-02c1-11f1-a139-0a58ac1896e8has completed successfully @ 02/05/26 18:38:20.735 STEP: Verify Application restore @ 02/05/26 18:38:20.74 STEP: Verify Application deployment for case django-persistent @ 02/05/26 18:38:20.74 2026/02/05 18:38:20 Using admin kubeconfig for with_validate operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Get the latest build name] *** changed: [localhost] FAILED - RETRYING: [localhost]: Wait for build to complete successfully (60 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Wait for build to complete successfully] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Display build completion status] *** ok: [localhost] => {  "msg": "Build django-psql-persistent-1 completed successfully" } [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Check postgresql pod status] *** ok: [localhost] FAILED - RETRYING: [localhost]: Check application pod status (30 retries left). FAILED - RETRYING: [localhost]: Check application pod status (29 retries left). FAILED - RETRYING: [localhost]: Check application pod status (28 retries left). FAILED - RETRYING: [localhost]: Check application pod status (27 retries left). FAILED - RETRYING: [localhost]: Check application pod status (26 retries left). FAILED - RETRYING: [localhost]: Check application pod status (25 retries left). FAILED - RETRYING: [localhost]: Check application pod status (24 retries left). FAILED - RETRYING: [localhost]: Check application pod status (23 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Check application pod status] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Get route] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Access the html file] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : set_fact] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Get num visits up to now] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Print num of visits] *** ok: [localhost] => {  "msg": "PASS: # of visits should be 2; actual 2" } PLAY RECAP ********************************************************************* localhost : ok=25  changed=6  unreachable=0 failed=0 skipped=13  rescued=0 ignored=0 2026/02/05 18:40:31 2026-02-05 18:38:22,567 p=66682 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:38:22,568 p=66682 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:38:22,900 p=66682 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:38:22,901 p=66682 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:38:23,228 p=66682 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:38:23,228 p=66682 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:38:23,557 p=66682 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:38:23,557 p=66682 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:38:23,575 p=66682 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:38:23,575 p=66682 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:38:23,575 p=66682 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:38:23,596 p=66682 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:38:23,596 p=66682 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:38:23,612 p=66682 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:38:23,613 p=66682 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:38:24,057 p=66682 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:38:24,057 p=66682 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:38:24,057 p=66682 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:38:24,058 p=66682 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:38:24,084 p=66682 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:38:24,085 p=66682 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:38:24,109 p=66682 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:38:24,109 p=66682 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:38:24,112 p=66682 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:38:24,777 p=66682 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:38:24,777 p=66682 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:38:25,294 p=66682 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Get the latest build name] *** 2026-02-05 18:38:25,295 p=66682 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:38:25,673 p=66682 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait for build to complete successfully (60 retries left). 2026-02-05 18:38:56,183 p=66682 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Wait for build to complete successfully] *** 2026-02-05 18:38:56,183 p=66682 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:38:56,216 p=66682 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Display build completion status] *** 2026-02-05 18:38:56,217 p=66682 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Build django-psql-persistent-1 completed successfully" } 2026-02-05 18:38:57,897 p=66682 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Check postgresql pod status] *** 2026-02-05 18:38:57,898 p=66682 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:38:57,899 p=66682 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:38:57,899 p=66682 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:38:57,899 p=66682 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:38:57,899 p=66682 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:38:59,398 p=66682 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check application pod status (30 retries left). 2026-02-05 18:39:10,605 p=66682 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check application pod status (29 retries left). 2026-02-05 18:39:21,890 p=66682 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check application pod status (28 retries left). 2026-02-05 18:39:32,890 p=66682 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check application pod status (27 retries left). 2026-02-05 18:39:43,938 p=66682 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check application pod status (26 retries left). 2026-02-05 18:39:55,222 p=66682 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check application pod status (25 retries left). 2026-02-05 18:40:06,512 p=66682 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check application pod status (24 retries left). 2026-02-05 18:40:17,620 p=66682 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check application pod status (23 retries left). 2026-02-05 18:40:28,881 p=66682 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Check application pod status] *** 2026-02-05 18:40:28,881 p=66682 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:40:30,865 p=66682 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Get route] *** 2026-02-05 18:40:30,866 p=66682 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:40:31,374 p=66682 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Access the html file] *** 2026-02-05 18:40:31,375 p=66682 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:40:31,400 p=66682 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : set_fact] *** 2026-02-05 18:40:31,400 p=66682 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:40:31,853 p=66682 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Get num visits up to now] *** 2026-02-05 18:40:31,853 p=66682 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:40:31,904 p=66682 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Print num of visits] *** 2026-02-05 18:40:31,904 p=66682 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "PASS: # of visits should be 2; actual 2" } 2026-02-05 18:40:31,909 p=66682 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:40:31,909 p=66682 u=1001930000 n=ansible INFO| localhost : ok=25 changed=6 unreachable=0 failed=0 skipped=13 rescued=0 ignored=0 < Exit [It] [tc-id:OADP-122] [interop] [skip-disconnected] [Tier0] [vf:csi-snapshots] Django application with BSL&CSI @ 02/05/26 18:40:31.971 (6m11.835s) > Enter [JustAfterEach] TOP-LEVEL @ 02/05/26 18:40:31.971 2026/02/05 18:40:31 Using Must-gather image: registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 Secret deletion flag: true Deleting cloud credentials secret cloud-credentials in namespace openshift-adp < Exit [JustAfterEach] TOP-LEVEL @ 02/05/26 18:40:31.998 (26ms) > Enter [DeferCleanup (Each)] Application backup @ 02/05/26 18:40:31.998 < Exit [DeferCleanup (Each)] Application backup @ 02/05/26 18:40:32 (3ms) > Enter [DeferCleanup (Each)] Application backup @ 02/05/26 18:40:32 < Exit [DeferCleanup (Each)] Application backup @ 02/05/26 18:40:32.001 (0s) > Enter [DeferCleanup (Each)] Application backup @ 02/05/26 18:40:32.001 2026/02/05 18:40:32 Reset number of visits to 0 2026/02/05 18:40:32 Cleaning app 2026/02/05 18:40:32 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Remove namespace test-oadp-122] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=16  changed=5  unreachable=0 failed=0 skipped=22  rescued=0 ignored=0 2026/02/05 18:41:03 2026-02-05 18:40:34,066 p=67161 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:40:34,066 p=67161 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:40:34,481 p=67161 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:40:34,481 p=67161 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:40:34,889 p=67161 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:40:34,889 p=67161 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:40:35,313 p=67161 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:40:35,313 p=67161 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:40:35,336 p=67161 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:40:35,337 p=67161 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:40:35,337 p=67161 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:40:35,364 p=67161 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:40:35,364 p=67161 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:40:35,385 p=67161 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:40:35,386 p=67161 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:40:35,922 p=67161 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:40:35,922 p=67161 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:40:35,922 p=67161 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:40:35,923 p=67161 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:40:35,955 p=67161 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:40:35,955 p=67161 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:40:35,976 p=67161 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:40:35,976 p=67161 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:40:35,979 p=67161 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:40:36,608 p=67161 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:40:36,608 p=67161 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:41:02,969 p=67161 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-django : Remove namespace test-oadp-122] *** 2026-02-05 18:41:02,969 p=67161 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:41:02,970 p=67161 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:41:02,970 p=67161 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:41:02,971 p=67161 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:41:02,971 p=67161 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:41:03,416 p=67161 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:41:03,416 p=67161 u=1001930000 n=ansible INFO| localhost : ok=16 changed=5 unreachable=0 failed=0 skipped=22 rescued=0 ignored=0 < Exit [DeferCleanup (Each)] Application backup @ 02/05/26 18:41:03.475 (31.474s) > Enter [DeferCleanup (Each)] Application backup @ 02/05/26 18:41:03.475 2026/02/05 18:41:03 Cleaning setup resources for the backup 2026/02/05 18:41:03 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 18:41:03 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2026/02/05 18:41:03 Deleting VolumeSnapshotClass 'example-snapclass' < Exit [DeferCleanup (Each)] Application backup @ 02/05/26 18:41:03.489 (14ms) > Enter [DeferCleanup (Each)] Application backup @ 02/05/26 18:41:03.489 2026/02/05 18:41:03 Deleting DPA CR < Exit [DeferCleanup (Each)] Application backup @ 02/05/26 18:41:03.496 (7ms) • [403.370 seconds] ------------------------------ SS ------------------------------ Backup restore tests Application backup [tc-id:OADP-352][interop][skip-disconnected][smoke] [Tier0] [vf:volume-snapshot-location] Django application with BSL&VSL [vsl] /alabama/cspi/e2e/app_backup/backup_restore.go:145 > Enter [BeforeEach] TOP-LEVEL @ 02/05/26 18:41:03.496 < Exit [BeforeEach] TOP-LEVEL @ 02/05/26 18:41:03.496 (0s) > Enter [BeforeEach] Backup restore tests @ 02/05/26 18:41:03.496 < Exit [BeforeEach] Backup restore tests @ 02/05/26 18:41:03.503 (7ms) > Enter [JustBeforeEach] TOP-LEVEL @ 02/05/26 18:41:03.503 < Exit [JustBeforeEach] TOP-LEVEL @ 02/05/26 18:41:03.503 (0s) > Enter [It] [tc-id:OADP-352][interop][skip-disconnected][smoke] [Tier0] [vf:volume-snapshot-location] Django application with BSL&VSL @ 02/05/26 18:41:03.503 2026/02/05 18:41:03 Check if VSL custom credentials exist 2026/02/05 18:41:03 Check if the cloud provider is AWS 2026/02/05 18:41:03 Delete all downloadrequest django-persistent-48f83df5-02c1-11f1-a139-0a58ac1896e8-14f67ab4-4668-4740-9b77-b5ed80d48c71 django-persistent-48f83df5-02c1-11f1-a139-0a58ac1896e8-749f1555-184c-4119-9aab-f0489b59aed5 django-persistent-48f83df5-02c1-11f1-a139-0a58ac1896e8-f6fd67de-5967-4a60-b7df-a6c90e651a63 STEP: Create DPA CR @ 02/05/26 18:41:03.562 2026/02/05 18:41:03 vsl 2026/02/05 18:41:03 Check if VSL custom credentials exist 2026/02/05 18:41:03 Check if the cloud provider is AWS 2026/02/05 18:41:03 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "153c9853-1776-481b-b49c-646e20b7fdc1", "resourceVersion": "199563", "generation": 1, "creationTimestamp": "2026-02-05T18:41:03Z", "managedFields": [ { "manager": "e2e.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T18:41:03Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8" }, "default": true } } ], "snapshotLocations": [ { "velero": { "provider": "aws", "config": { "profile": "default", "region": "us-east-2" } } } ], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift" ], "disableFsBackup": false } }, "features": null, "logFormat": "text" }, "status": {} } Delete all the backups that remained in the phase InProgress Deleting backup CRs in progress Deletion of backup CRs in progress completed Delete all the restores that remained in the phase InProgress Deleting restore CRs in progress Deletion of restore CRs in progress completed STEP: Verify DPA CR setup @ 02/05/26 18:41:03.643 2026/02/05 18:41:03 Waiting for velero pod to be running 2026/02/05 18:41:03 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete' 2026/02/05 18:41:03 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "153c9853-1776-481b-b49c-646e20b7fdc1", "resourceVersion": "199563", "generation": 1, "creationTimestamp": "2026-02-05T18:41:03Z", "managedFields": [ { "manager": "e2e.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T18:41:03Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8" }, "default": true } } ], "snapshotLocations": [ { "velero": { "provider": "aws", "config": { "profile": "default", "region": "us-east-2" } } } ], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift" ], "disableFsBackup": false } }, "features": null, "logFormat": "text" }, "status": {} } 2026/02/05 18:41:08 DPA successfully reconciled STEP: Prepare backup resources, depending on the volumes backup type @ 02/05/26 18:41:08.659 2026/02/05 18:41:08 Checking default storage class count [SKIPPED] in [It] - /alabama/cspi/lib/backup.go:428 @ 02/05/26 18:41:08.671 < Exit [It] [tc-id:OADP-352][interop][skip-disconnected][smoke] [Tier0] [vf:volume-snapshot-location] Django application with BSL&VSL @ 02/05/26 18:41:08.672 (5.168s) > Enter [JustAfterEach] TOP-LEVEL @ 02/05/26 18:41:08.672 2026/02/05 18:41:08 Using Must-gather image: registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 Secret deletion flag: true Deleting cloud credentials secret cloud-credentials in namespace openshift-adp < Exit [JustAfterEach] TOP-LEVEL @ 02/05/26 18:41:08.678 (6ms) > Enter [DeferCleanup (Each)] Application backup @ 02/05/26 18:41:08.678 2026/02/05 18:41:08 Deleting DPA CR < Exit [DeferCleanup (Each)] Application backup @ 02/05/26 18:41:08.683 (5ms) S [SKIPPED] [5.187 seconds] Backup restore tests Application backup [It] [tc-id:OADP-352][interop][skip-disconnected][smoke] [Tier0] [vf:volume-snapshot-location] Django application with BSL&VSL [vsl] /alabama/cspi/e2e/app_backup/backup_restore.go:145 [SKIPPED] Skipping VSL test because the default StorageClass provisioner openshift-storage.rbd.csi.ceph.com is not supported In [It] at: /alabama/cspi/lib/backup.go:428 @ 02/05/26 18:41:08.671 ------------------------------ SS ------------------------------ Backup restore tests Application backup [tc-id:OADP-97][interop] [Tier0] [vf:fsb-restic] Empty-project application with Restic /alabama/cspi/e2e/app_backup/backup_restore.go:191 > Enter [BeforeEach] TOP-LEVEL @ 02/05/26 18:41:08.683 < Exit [BeforeEach] TOP-LEVEL @ 02/05/26 18:41:08.683 (0s) > Enter [BeforeEach] Backup restore tests @ 02/05/26 18:41:08.683 < Exit [BeforeEach] Backup restore tests @ 02/05/26 18:41:08.69 (7ms) > Enter [JustBeforeEach] TOP-LEVEL @ 02/05/26 18:41:08.69 < Exit [JustBeforeEach] TOP-LEVEL @ 02/05/26 18:41:08.69 (0s) > Enter [It] [tc-id:OADP-97][interop] [Tier0] [vf:fsb-restic] Empty-project application with Restic @ 02/05/26 18:41:08.691 2026/02/05 18:41:08 Delete all downloadrequest No download requests are found STEP: Create DPA CR @ 02/05/26 18:41:08.697 2026/02/05 18:41:08 restic 2026/02/05 18:41:08 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "5e54c9f7-523a-4194-a53e-a43aa61486aa", "resourceVersion": "199713", "generation": 1, "creationTimestamp": "2026-02-05T18:41:08Z", "managedFields": [ { "manager": "e2e.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T18:41:08Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:nodeAgent": { ".": {}, "f:enable": {}, "f:podConfig": { ".": {}, "f:resourceAllocations": {} }, "f:uploaderType": {} }, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift" ], "disableFsBackup": false }, "nodeAgent": { "enable": true, "podConfig": { "resourceAllocations": {} }, "uploaderType": "restic" } }, "features": null, "logFormat": "text" }, "status": {} } Delete all the backups that remained in the phase InProgress Deleting backup CRs in progress Deletion of backup CRs in progress completed Delete all the restores that remained in the phase InProgress Deleting restore CRs in progress Deletion of restore CRs in progress completed STEP: Verify DPA CR setup @ 02/05/26 18:41:08.854 2026/02/05 18:41:08 Waiting for velero pod to be running 2026/02/05 18:41:08 pod: velero-7bf89c676-qzxm9 is not yet running with status: {Pending [] [] [] [] [] Burstable [] []} 2026/02/05 18:41:13 pod: velero-7bf89c676-qzxm9 is not yet running with status: {Pending [{PodReadyToStartContainers True 0001-01-01 00:00:00 +0000 UTC 2026-02-05 18:41:09 +0000 UTC } {Initialized True 0001-01-01 00:00:00 +0000 UTC 2026-02-05 18:41:12 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2026-02-05 18:41:08 +0000 UTC ContainersNotReady containers with unready status: [velero]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2026-02-05 18:41:08 +0000 UTC ContainersNotReady containers with unready status: [velero]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2026-02-05 18:41:08 +0000 UTC }] 10.0.60.83 [{10.0.60.83}] 10.129.3.23 [{10.129.3.23}] 2026-02-05 18:41:08 +0000 UTC [{openshift-velero-plugin {nil nil &ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2026-02-05 18:41:09 +0000 UTC,FinishedAt:2026-02-05 18:41:09 +0000 UTC,ContainerID:cri-o://f98b2b48258a23214925eb51d1ff2d8884fd937024aa75a0ea917f04ab3dfbdf,}} {nil nil nil} true 0 registry.redhat.io/oadp/oadp-velero-plugin-rhel9@sha256:9b888c75a1ddf274b1f0aa053ddbbc9acc3270417712456ffa29ef81a883b38a registry.redhat.io/oadp/oadp-velero-plugin-rhel9@sha256:212589b9f5b75a043c9a7094cb681a39687795c5e78e625beb6d00960ea57e70 cri-o://f98b2b48258a23214925eb51d1ff2d8884fd937024aa75a0ea917f04ab3dfbdf 0xc000c032a9 map[cpu:{{500 -3} {} 500m DecimalSI} memory:{{134217728 0} {} BinarySI}] &ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{134217728 0} {} BinarySI},},Claims:[]ResourceClaim{},} [{plugins /target false } {kube-api-access-5bscc /var/run/secrets/kubernetes.io/serviceaccount true 0xc00071d0a0}] &ContainerUser{Linux:&LinuxContainerUser{UID:1000740000,GID:0,SupplementalGroups:[0 1000740000],},} []} {velero-plugin-for-aws {nil nil &ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2026-02-05 18:41:09 +0000 UTC,FinishedAt:2026-02-05 18:41:10 +0000 UTC,ContainerID:cri-o://480859ef426abb375b81288ff6da7c9b2eaff135c6795d95be9d854e4ef51727,}} {nil nil nil} true 0 registry.redhat.io/oadp/oadp-velero-plugin-for-aws-rhel9@sha256:2a099649d3d7101a0b6dff9f6372bc76903ba6ecb6578dbeef8a8b3853f48026 registry.redhat.io/oadp/oadp-velero-plugin-for-aws-rhel9@sha256:2a099649d3d7101a0b6dff9f6372bc76903ba6ecb6578dbeef8a8b3853f48026 cri-o://480859ef426abb375b81288ff6da7c9b2eaff135c6795d95be9d854e4ef51727 0xc000c03308 map[cpu:{{500 -3} {} 500m DecimalSI} memory:{{134217728 0} {} BinarySI}] &ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{134217728 0} {} BinarySI},},Claims:[]ResourceClaim{},} [{plugins /target false } {kube-api-access-5bscc /var/run/secrets/kubernetes.io/serviceaccount true 0xc00071d110}] &ContainerUser{Linux:&LinuxContainerUser{UID:1000740000,GID:0,SupplementalGroups:[0 1000740000],},} []} {kubevirt-velero-plugin {nil nil &ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2026-02-05 18:41:10 +0000 UTC,FinishedAt:2026-02-05 18:41:10 +0000 UTC,ContainerID:cri-o://49d3c881d73691d84e97625784900a30f34008ae5e09b52be6af8b2cb4e4cf5b,}} {nil nil nil} true 0 registry.redhat.io/oadp/oadp-kubevirt-velero-plugin-rhel9@sha256:77d6057b1783872ec65d7d6a88d8a1212c38aacc982c7efd46ed2eb77b5e9e70 registry.redhat.io/oadp/oadp-kubevirt-velero-plugin-rhel9@sha256:684020e409da37fd3a41935b51ac22e506fb7a45e787ae8c0cfd6ac0dfcbff09 cri-o://49d3c881d73691d84e97625784900a30f34008ae5e09b52be6af8b2cb4e4cf5b 0xc000c033b9 map[cpu:{{500 -3} {} 500m DecimalSI} memory:{{134217728 0} {} BinarySI}] &ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{134217728 0} {} BinarySI},},Claims:[]ResourceClaim{},} [{plugins /target false } {kube-api-access-5bscc /var/run/secrets/kubernetes.io/serviceaccount true 0xc00071d180}] &ContainerUser{Linux:&LinuxContainerUser{UID:1000740000,GID:0,SupplementalGroups:[0 1000740000],},} []} {hypershift-oadp-plugin {nil nil &ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2026-02-05 18:41:11 +0000 UTC,FinishedAt:2026-02-05 18:41:11 +0000 UTC,ContainerID:cri-o://1a615c8c3ea4806d8b1c65f342d323f6e34cbd1173ca8143afa65c6c9fd3ef34,}} {nil nil nil} true 0 registry.redhat.io/oadp/oadp-hypershift-velero-plugin-rhel9@sha256:f8798364f94bb1bf4db264b0439c5a280b40cafa408c47b4160d9cc9c5d87e53 registry.redhat.io/oadp/oadp-hypershift-velero-plugin-rhel9@sha256:5d9c2ff91b5851f486fdcadcf9991007cdbe7a81f57774c6d0b3798091316af6 cri-o://1a615c8c3ea4806d8b1c65f342d323f6e34cbd1173ca8143afa65c6c9fd3ef34 0xc000c03418 map[cpu:{{500 -3} {} 500m DecimalSI} memory:{{134217728 0} {} BinarySI}] &ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{cpu: {{500 -3} {} 500m DecimalSI},memory: {{134217728 0} {} BinarySI},},Claims:[]ResourceClaim{},} [{plugins /target false } {kube-api-access-5bscc /var/run/secrets/kubernetes.io/serviceaccount true 0xc00071d1f0}] &ContainerUser{Linux:&LinuxContainerUser{UID:1000740000,GID:0,SupplementalGroups:[0 1000740000],},} []}] [{velero {&ContainerStateWaiting{Reason:PodInitializing,Message:,} nil nil} {nil nil nil} false 0 registry.redhat.io/oadp/oadp-velero-rhel9@sha256:dd5897b1579599cfa8d8a03a1c8d3cf68e3927c4ba5dee4e33c2a2d4c9e6ed89 0xc000c034cf map[] nil [{plugins /plugins false } {scratch /scratch false } {certs /etc/ssl/certs false } {bound-sa-token /var/run/secrets/openshift/serviceaccount true 0xc00071d200} {kube-api-access-5bscc /var/run/secrets/kubernetes.io/serviceaccount true 0xc00071d210}] nil []}] Burstable [] []} 2026/02/05 18:41:18 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete' 2026/02/05 18:41:18 DPA successfully reconciled STEP: Prepare backup resources, depending on the volumes backup type @ 02/05/26 18:41:18.892 2026/02/05 18:41:18 Checking for correct number of running NodeAgent pods... STEP: Installing application for case empty-project-e2e @ 02/05/26 18:41:18.9 2026/02/05 18:41:18 🔄 [Attempt 1/3] Executing operation: Deploy application ocp-project 2026/02/05 18:41:18 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-project : Deploy project with labels and selectors] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=16  changed=5  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026/02/05 18:41:25 2026-02-05 18:41:21,160 p=67376 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:41:21,161 p=67376 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:41:21,548 p=67376 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:41:21,549 p=67376 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:41:21,994 p=67376 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:41:21,995 p=67376 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:41:22,425 p=67376 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:41:22,425 p=67376 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:41:22,448 p=67376 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:41:22,449 p=67376 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:41:22,449 p=67376 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:41:22,472 p=67376 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:41:22,472 p=67376 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:41:22,491 p=67376 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:41:22,492 p=67376 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:41:23,043 p=67376 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:41:23,044 p=67376 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:41:23,044 p=67376 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:41:23,044 p=67376 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:41:23,081 p=67376 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:41:23,081 p=67376 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:41:23,108 p=67376 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:41:23,108 p=67376 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:41:23,113 p=67376 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:41:23,872 p=67376 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:41:23,873 p=67376 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:41:25,527 p=67376 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-project : Deploy project with labels and selectors] *** 2026-02-05 18:41:25,527 p=67376 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:41:25,528 p=67376 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:41:25,528 p=67376 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:41:25,528 p=67376 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:41:25,528 p=67376 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:41:25,586 p=67376 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:41:25,586 p=67376 u=1001930000 n=ansible INFO| localhost : ok=16 changed=5 unreachable=0 failed=0 skipped=4 rescued=0 ignored=0 STEP: Verify Application deployment @ 02/05/26 18:41:25.705 2026/02/05 18:41:25 Using admin kubeconfig for with_validate operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-project : Check project status] *** ok: [localhost] PLAY RECAP ********************************************************************* localhost : ok=16  changed=4  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026/02/05 18:41:31 2026-02-05 18:41:27,982 p=67569 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:41:27,982 p=67569 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:41:28,381 p=67569 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:41:28,381 p=67569 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:41:28,712 p=67569 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:41:28,713 p=67569 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:41:29,030 p=67569 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:41:29,030 p=67569 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:41:29,048 p=67569 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:41:29,048 p=67569 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:41:29,048 p=67569 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:41:29,069 p=67569 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:41:29,070 p=67569 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:41:29,084 p=67569 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:41:29,085 p=67569 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:41:29,526 p=67569 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:41:29,527 p=67569 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:41:29,527 p=67569 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:41:29,527 p=67569 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:41:29,557 p=67569 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:41:29,557 p=67569 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:41:29,583 p=67569 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:41:29,583 p=67569 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:41:29,586 p=67569 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:41:30,190 p=67569 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:41:30,190 p=67569 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:41:31,314 p=67569 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-project : Check project status] *** 2026-02-05 18:41:31,314 p=67569 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:41:31,315 p=67569 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:41:31,315 p=67569 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:41:31,315 p=67569 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:41:31,315 p=67569 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:41:31,340 p=67569 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:41:31,340 p=67569 u=1001930000 n=ansible INFO| localhost : ok=16 changed=4 unreachable=0 failed=0 skipped=4 rescued=0 ignored=0 2026/02/05 18:41:31 {{ } { } []} STEP: Creating backup empty-project-e2e-3c7cac45-02c2-11f1-a139-0a58ac1896e8 @ 02/05/26 18:41:31.401 2026/02/05 18:41:31 Wait until backup empty-project-e2e-3c7cac45-02c2-11f1-a139-0a58ac1896e8 is completed backup phase: Completed STEP: Verify backup empty-project-e2e-3c7cac45-02c2-11f1-a139-0a58ac1896e8 has completed successfully @ 02/05/26 18:41:51.413 2026/02/05 18:41:51 Backup for case empty-project-e2e succeeded STEP: Delete the appplication resources empty-project-e2e @ 02/05/26 18:41:51.449 STEP: Cleanup Application for case empty-project-e2e @ 02/05/26 18:41:51.449 2026/02/05 18:41:51 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-project : Remove namespace test-oadp-97] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=16  changed=5  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026/02/05 18:42:06 2026-02-05 18:41:53,134 p=67777 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:41:53,134 p=67777 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:41:53,448 p=67777 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:41:53,448 p=67777 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:41:53,771 p=67777 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:41:53,771 p=67777 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:41:54,085 p=67777 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:41:54,086 p=67777 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:41:54,104 p=67777 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:41:54,104 p=67777 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:41:54,104 p=67777 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:41:54,126 p=67777 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:41:54,127 p=67777 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:41:54,146 p=67777 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:41:54,147 p=67777 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:41:54,584 p=67777 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:41:54,584 p=67777 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:41:54,584 p=67777 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:41:54,584 p=67777 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:41:54,612 p=67777 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:41:54,612 p=67777 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:41:54,632 p=67777 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:41:54,633 p=67777 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:41:54,635 p=67777 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:41:55,243 p=67777 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:41:55,244 p=67777 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:42:06,405 p=67777 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-project : Remove namespace test-oadp-97] *** 2026-02-05 18:42:06,406 p=67777 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:42:06,406 p=67777 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:42:06,406 p=67777 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:42:06,407 p=67777 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:42:06,407 p=67777 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:42:06,482 p=67777 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:42:06,482 p=67777 u=1001930000 n=ansible INFO| localhost : ok=16 changed=5 unreachable=0 failed=0 skipped=4 rescued=0 ignored=0 2026/02/05 18:42:06 Creating restore empty-project-e2e-3c7cac45-02c2-11f1-a139-0a58ac1896e8 for case empty-project-e2e-3c7cac45-02c2-11f1-a139-0a58ac1896e8 STEP: Create restore empty-project-e2e-3c7cac45-02c2-11f1-a139-0a58ac1896e8 from backup empty-project-e2e-3c7cac45-02c2-11f1-a139-0a58ac1896e8 @ 02/05/26 18:42:06.536 2026/02/05 18:42:06 Wait until restore empty-project-e2e-3c7cac45-02c2-11f1-a139-0a58ac1896e8 is complete restore phase: Completed 2026/02/05 18:42:16 No PodVolumeBackup CR found for the Restore STEP: Verify restore empty-project-e2e-3c7cac45-02c2-11f1-a139-0a58ac1896e8has completed successfully @ 02/05/26 18:42:16.555 STEP: Verify Application restore @ 02/05/26 18:42:16.557 STEP: Verify Application deployment for case empty-project-e2e @ 02/05/26 18:42:16.557 2026/02/05 18:42:16 Using admin kubeconfig for with_validate operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-project : Check project status] *** ok: [localhost] PLAY RECAP ********************************************************************* localhost : ok=16  changed=4  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026/02/05 18:42:21 2026-02-05 18:42:18,218 p=67991 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:42:18,218 p=67991 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:42:18,530 p=67991 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:42:18,530 p=67991 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:42:18,854 p=67991 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:42:18,854 p=67991 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:42:19,168 p=67991 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:42:19,169 p=67991 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:42:19,187 p=67991 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:42:19,188 p=67991 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:42:19,188 p=67991 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:42:19,208 p=67991 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:42:19,208 p=67991 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:42:19,222 p=67991 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:42:19,223 p=67991 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:42:19,649 p=67991 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:42:19,649 p=67991 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:42:19,649 p=67991 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:42:19,649 p=67991 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:42:19,677 p=67991 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:42:19,677 p=67991 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:42:19,698 p=67991 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:42:19,699 p=67991 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:42:19,701 p=67991 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:42:20,305 p=67991 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:42:20,305 p=67991 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:42:21,412 p=67991 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-project : Check project status] *** 2026-02-05 18:42:21,412 p=67991 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:42:21,413 p=67991 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:42:21,413 p=67991 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:42:21,413 p=67991 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:42:21,413 p=67991 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:42:21,438 p=67991 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:42:21,438 p=67991 u=1001930000 n=ansible INFO| localhost : ok=16 changed=4 unreachable=0 failed=0 skipped=4 rescued=0 ignored=0 < Exit [It] [tc-id:OADP-97][interop] [Tier0] [vf:fsb-restic] Empty-project application with Restic @ 02/05/26 18:42:21.495 (1m12.804s) > Enter [JustAfterEach] TOP-LEVEL @ 02/05/26 18:42:21.495 2026/02/05 18:42:21 Using Must-gather image: registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 Secret deletion flag: true Deleting cloud credentials secret cloud-credentials in namespace openshift-adp < Exit [JustAfterEach] TOP-LEVEL @ 02/05/26 18:42:21.501 (6ms) > Enter [DeferCleanup (Each)] Application backup @ 02/05/26 18:42:21.501 < Exit [DeferCleanup (Each)] Application backup @ 02/05/26 18:42:21.504 (3ms) > Enter [DeferCleanup (Each)] Application backup @ 02/05/26 18:42:21.504 < Exit [DeferCleanup (Each)] Application backup @ 02/05/26 18:42:21.504 (0s) > Enter [DeferCleanup (Each)] Application backup @ 02/05/26 18:42:21.504 2026/02/05 18:42:21 Cleaning app 2026/02/05 18:42:21 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-project : Remove namespace test-oadp-97] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=16  changed=5  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026/02/05 18:42:36 2026-02-05 18:42:23,186 p=68204 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:42:23,187 p=68204 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:42:23,495 p=68204 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:42:23,495 p=68204 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:42:23,804 p=68204 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:42:23,805 p=68204 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:42:24,122 p=68204 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:42:24,122 p=68204 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:42:24,140 p=68204 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:42:24,141 p=68204 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:42:24,141 p=68204 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:42:24,161 p=68204 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:42:24,161 p=68204 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:42:24,177 p=68204 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:42:24,177 p=68204 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:42:24,606 p=68204 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:42:24,607 p=68204 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:42:24,607 p=68204 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:42:24,607 p=68204 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:42:24,640 p=68204 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:42:24,641 p=68204 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:42:24,663 p=68204 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:42:24,663 p=68204 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:42:24,666 p=68204 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:42:25,266 p=68204 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:42:25,266 p=68204 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:42:36,394 p=68204 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-project : Remove namespace test-oadp-97] *** 2026-02-05 18:42:36,395 p=68204 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:42:36,395 p=68204 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:42:36,395 p=68204 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:42:36,395 p=68204 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:42:36,395 p=68204 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:42:36,470 p=68204 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:42:36,470 p=68204 u=1001930000 n=ansible INFO| localhost : ok=16 changed=5 unreachable=0 failed=0 skipped=4 rescued=0 ignored=0 < Exit [DeferCleanup (Each)] Application backup @ 02/05/26 18:42:36.526 (15.022s) > Enter [DeferCleanup (Each)] Application backup @ 02/05/26 18:42:36.526 2026/02/05 18:42:36 Cleaning setup resources for the backup < Exit [DeferCleanup (Each)] Application backup @ 02/05/26 18:42:36.526 (0s) > Enter [DeferCleanup (Each)] Application backup @ 02/05/26 18:42:36.526 2026/02/05 18:42:36 Deleting DPA CR < Exit [DeferCleanup (Each)] Application backup @ 02/05/26 18:42:36.56 (34ms) • [87.877 seconds] ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ [skip-disconnected] Restore hooks tests Successful Init hook [tc-id:OADP-164][interop][smoke] [Tier0] MySQL app with Restic /alabama/cspi/e2e/hooks/restore_hooks.go:134 > Enter [BeforeEach] TOP-LEVEL @ 02/05/26 18:42:36.561 < Exit [BeforeEach] TOP-LEVEL @ 02/05/26 18:42:36.561 (0s) > Enter [BeforeEach] [skip-disconnected] Restore hooks tests @ 02/05/26 18:42:36.561 < Exit [BeforeEach] [skip-disconnected] Restore hooks tests @ 02/05/26 18:42:36.567 (6ms) > Enter [JustBeforeEach] TOP-LEVEL @ 02/05/26 18:42:36.567 < Exit [JustBeforeEach] TOP-LEVEL @ 02/05/26 18:42:36.567 (0s) > Enter [It] [tc-id:OADP-164][interop][smoke] [Tier0] MySQL app with Restic @ 02/05/26 18:42:36.567 2026/02/05 18:42:36 Delete all downloadrequest No download requests are found STEP: Create DPA CR @ 02/05/26 18:42:36.571 2026/02/05 18:42:36 restic 2026/02/05 18:42:36 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "f3c6d222-5589-4a49-ae0a-84b3b01ffa79", "resourceVersion": "201168", "generation": 1, "creationTimestamp": "2026-02-05T18:42:36Z", "managedFields": [ { "manager": "e2e.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T18:42:36Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:nodeAgent": { ".": {}, "f:enable": {}, "f:podConfig": { ".": {}, "f:resourceAllocations": {} }, "f:uploaderType": {} }, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift" ], "disableFsBackup": false }, "nodeAgent": { "enable": true, "podConfig": { "resourceAllocations": {} }, "uploaderType": "restic" } }, "features": null, "logFormat": "text" }, "status": {} } Delete all the backups that remained in the phase InProgress Deleting backup CRs in progress Deletion of backup CRs in progress completed Delete all the restores that remained in the phase InProgress Deleting restore CRs in progress Deletion of restore CRs in progress completed STEP: Verify DPA CR setup @ 02/05/26 18:42:36.631 2026/02/05 18:42:36 Waiting for velero pod to be running 2026/02/05 18:42:36 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete' 2026/02/05 18:42:36 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "f3c6d222-5589-4a49-ae0a-84b3b01ffa79", "resourceVersion": "201168", "generation": 1, "creationTimestamp": "2026-02-05T18:42:36Z", "managedFields": [ { "manager": "e2e.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T18:42:36Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:nodeAgent": { ".": {}, "f:enable": {}, "f:podConfig": { ".": {}, "f:resourceAllocations": {} }, "f:uploaderType": {} }, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift" ], "disableFsBackup": false }, "nodeAgent": { "enable": true, "podConfig": { "resourceAllocations": {} }, "uploaderType": "restic" } }, "features": null, "logFormat": "text" }, "status": {} } 2026/02/05 18:42:41 DPA successfully reconciled STEP: Prepare backup resources, depending on the volumes backup type @ 02/05/26 18:42:41.673 2026/02/05 18:42:41 Checking for correct number of running NodeAgent pods... STEP: Installing application for case mysql-hooks-e2e @ 02/05/26 18:42:41.683 2026/02/05 18:42:41 🔄 [Attempt 1/3] Executing operation: Deploy application ocp-mysql 2026/02/05 18:42:41 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check namespace test-oadp-164] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Create namespace] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check if SecurityContextConstraints are available] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Set has_scc variable] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Deploy a mysql pod] *** changed: [localhost] FAILED - RETRYING: [localhost]: Check pod status (30 retries left). FAILED - RETRYING: [localhost]: Check pod status (29 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check pod status] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Copy mysql provision script to pod] *** changed: [localhost] FAILED - RETRYING: [localhost]: Wait until service ready for connections (30 retries left). FAILED - RETRYING: [localhost]: Wait until service ready for connections (29 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Provision the mysql database] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Add dummy data into mysql-data1 pvc] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Create md5 hashes for the files] *** changed: [localhost] Pausing for 30 seconds TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Pause After Create md5 hashes for the files] *** ok: [localhost] PLAY RECAP ********************************************************************* localhost : ok=27  changed=11  unreachable=0 failed=0 skipped=9  rescued=0 ignored=0 2026/02/05 18:43:47 2026-02-05 18:42:43,378 p=68416 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:42:43,379 p=68416 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:42:43,688 p=68416 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:42:43,689 p=68416 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:42:44,003 p=68416 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:42:44,003 p=68416 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:42:44,324 p=68416 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:42:44,324 p=68416 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:42:44,342 p=68416 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:42:44,342 p=68416 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:42:44,343 p=68416 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:42:44,363 p=68416 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:42:44,363 p=68416 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:42:44,378 p=68416 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:42:44,378 p=68416 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:42:44,813 p=68416 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:42:44,814 p=68416 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:42:44,814 p=68416 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:42:44,814 p=68416 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:42:44,842 p=68416 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:42:44,843 p=68416 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:42:44,864 p=68416 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:42:44,864 p=68416 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:42:44,867 p=68416 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:42:45,465 p=68416 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:42:45,465 p=68416 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:42:46,575 p=68416 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check namespace test-oadp-164] *** 2026-02-05 18:42:46,576 p=68416 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:42:46,576 p=68416 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:42:46,576 p=68416 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:42:46,577 p=68416 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:42:46,577 p=68416 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:42:46,919 p=68416 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Create namespace] *** 2026-02-05 18:42:46,919 p=68416 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:42:47,869 p=68416 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check if SecurityContextConstraints are available] *** 2026-02-05 18:42:47,870 p=68416 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:42:47,901 p=68416 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Set has_scc variable] *** 2026-02-05 18:42:47,901 p=68416 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:42:49,128 p=68416 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Deploy a mysql pod] *** 2026-02-05 18:42:49,129 p=68416 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:42:50,065 p=68416 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pod status (30 retries left). 2026-02-05 18:42:55,967 p=68416 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check pod status (29 retries left). 2026-02-05 18:43:01,874 p=68416 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check pod status] *** 2026-02-05 18:43:01,875 p=68416 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:43:02,426 p=68416 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Copy mysql provision script to pod] *** 2026-02-05 18:43:02,426 p=68416 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:43:02,805 p=68416 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until service ready for connections (30 retries left). 2026-02-05 18:43:08,157 p=68416 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Wait until service ready for connections (29 retries left). 2026-02-05 18:43:13,508 p=68416 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] *** 2026-02-05 18:43:13,509 p=68416 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:43:15,666 p=68416 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Provision the mysql database] *** 2026-02-05 18:43:15,666 p=68416 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:43:16,513 p=68416 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Add dummy data into mysql-data1 pvc] *** 2026-02-05 18:43:16,513 p=68416 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:43:17,154 p=68416 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Create md5 hashes for the files] *** 2026-02-05 18:43:17,154 p=68416 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:43:17,176 p=68416 u=1001930000 n=ansible INFO| Pausing for 30 seconds 2026-02-05 18:43:47,180 p=68416 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Pause After Create md5 hashes for the files] *** 2026-02-05 18:43:47,180 p=68416 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:43:47,313 p=68416 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:43:47,313 p=68416 u=1001930000 n=ansible INFO| localhost : ok=27 changed=11 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 STEP: Verify Application deployment @ 02/05/26 18:43:47.37 2026/02/05 18:43:47 Using admin kubeconfig for with_validate operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check mysql pod status] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Query the inserted data] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Validate test1 file has correct md5 hash] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=19  changed=7  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026/02/05 18:43:54 2026-02-05 18:43:49,049 p=68973 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:43:49,049 p=68973 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:43:49,369 p=68973 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:43:49,370 p=68973 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:43:49,682 p=68973 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:43:49,682 p=68973 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:43:49,997 p=68973 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:43:49,997 p=68973 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:43:50,014 p=68973 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:43:50,015 p=68973 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:43:50,015 p=68973 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:43:50,034 p=68973 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:43:50,035 p=68973 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:43:50,050 p=68973 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:43:50,050 p=68973 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:43:50,497 p=68973 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:43:50,498 p=68973 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:43:50,498 p=68973 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:43:50,498 p=68973 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:43:50,527 p=68973 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:43:50,527 p=68973 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:43:50,548 p=68973 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:43:50,548 p=68973 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:43:50,551 p=68973 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:43:51,154 p=68973 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:43:51,154 p=68973 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:43:52,496 p=68973 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check mysql pod status] *** 2026-02-05 18:43:52,497 p=68973 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:43:52,497 p=68973 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:43:52,497 p=68973 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:43:52,497 p=68973 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:43:52,497 p=68973 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:43:52,966 p=68973 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] *** 2026-02-05 18:43:52,966 p=68973 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:43:53,440 p=68973 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Query the inserted data] *** 2026-02-05 18:43:53,440 p=68973 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:43:54,067 p=68973 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Validate test1 file has correct md5 hash] *** 2026-02-05 18:43:54,067 p=68973 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:43:54,072 p=68973 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:43:54,072 p=68973 u=1001930000 n=ansible INFO| localhost : ok=19 changed=7 unreachable=0 failed=0 skipped=17 rescued=0 ignored=0 2026/02/05 18:43:54 ExtractTarGz: Create file /tmp/tempDir2129281176/world-db/world.sql 2026/02/05 18:43:54 2026/02/05 18:43:54 {{ } { } [{{ } {mysql-data test-oadp-164 3388bc60-4057-4d20-83db-693217cabaf7 201563 0 2026-02-05 18:42:49 +0000 UTC map[app:mysql testlabel:selectors testlabel2:foo] map[pv.kubernetes.io/bind-completed:yes pv.kubernetes.io/bound-by-controller:yes reclaimspace.csiaddons.openshift.io/cronjob:mysql-data-1770316969 reclaimspace.csiaddons.openshift.io/schedule:@weekly volume.beta.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com volume.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com] [] [kubernetes.io/pvc-protection] [{OpenAPI-Generator Update v1 2026-02-05 18:42:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:app":{},"f:testlabel":{},"f:testlabel2":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}} } {csi-addons-manager Update v1 2026-02-05 18:42:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:reclaimspace.csiaddons.openshift.io/cronjob":{},"f:reclaimspace.csiaddons.openshift.io/schedule":{}}}} } {kube-controller-manager Update v1 2026-02-05 18:42:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:pv.kubernetes.io/bind-completed":{},"f:pv.kubernetes.io/bound-by-controller":{},"f:volume.beta.kubernetes.io/storage-provisioner":{},"f:volume.kubernetes.io/storage-provisioner":{}}},"f:spec":{"f:volumeName":{}}} } {kube-controller-manager Update v1 2026-02-05 18:42:49 +0000 UTC FieldsV1 {"f:status":{"f:accessModes":{},"f:capacity":{".":{},"f:storage":{}},"f:phase":{}}} status}]} {[ReadWriteOnce] nil {map[] map[storage:{{2147483648 0} {} 2Gi BinarySI}]} pvc-3388bc60-4057-4d20-83db-693217cabaf7 0xc00078afc0 0xc00078afd0 nil nil } {Bound [ReadWriteOnce] map[storage:{{2147483648 0} {} 2Gi BinarySI}] [] map[] map[] nil}} {{ } {mysql-data1 test-oadp-164 248d9cb6-efe9-4202-818c-d087fd9a9f5c 201545 0 2026-02-05 18:42:49 +0000 UTC map[app:mysql testlabel:selectors testlabel2:foo] map[pv.kubernetes.io/bind-completed:yes pv.kubernetes.io/bound-by-controller:yes reclaimspace.csiaddons.openshift.io/cronjob:mysql-data1-1770316969 reclaimspace.csiaddons.openshift.io/schedule:@weekly volume.beta.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com volume.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com] [] [kubernetes.io/pvc-protection] [{OpenAPI-Generator Update v1 2026-02-05 18:42:49 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:app":{},"f:testlabel":{},"f:testlabel2":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}} } {csi-addons-manager Update v1 2026-02-05 18:42:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:reclaimspace.csiaddons.openshift.io/cronjob":{},"f:reclaimspace.csiaddons.openshift.io/schedule":{}}}} } {kube-controller-manager Update v1 2026-02-05 18:42:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:pv.kubernetes.io/bind-completed":{},"f:pv.kubernetes.io/bound-by-controller":{},"f:volume.beta.kubernetes.io/storage-provisioner":{},"f:volume.kubernetes.io/storage-provisioner":{}}},"f:spec":{"f:volumeName":{}}} } {kube-controller-manager Update v1 2026-02-05 18:42:49 +0000 UTC FieldsV1 {"f:status":{"f:accessModes":{},"f:capacity":{".":{},"f:storage":{}},"f:phase":{}}} status}]} {[ReadWriteOnce] nil {map[] map[storage:{{2147483648 0} {} 2Gi BinarySI}]} pvc-248d9cb6-efe9-4202-818c-d087fd9a9f5c 0xc00078b140 0xc00078b150 nil nil } {Bound [ReadWriteOnce] map[storage:{{2147483648 0} {} 2Gi BinarySI}] [] map[] map[] nil}}]} STEP: Creating backup mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8 @ 02/05/26 18:43:54.914 2026/02/05 18:43:54 Wait until backup mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8 is completed backup phase: Completed 2026/02/05 18:44:14 Verify the PodVolumeBackup is completed successfully and BackupRepository type is matching with DPA.nodeAgent.uploaderType 2026/02/05 18:44:14 apiVersion: velero.io/v1 kind: PodVolumeBackup metadata: annotations: velero.io/pvc-name: mysql-data1 creationTimestamp: "2026-02-05T18:43:59Z" generateName: mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8- generation: 4 labels: velero.io/backup-name: mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8 velero.io/backup-uid: 84071e76-02c5-4e0f-87f3-3327c3ca3cc7 velero.io/pvc-uid: 248d9cb6-efe9-4202-818c-d087fd9a9f5c managedFields: - apiVersion: velero.io/v1 fieldsType: FieldsV1 fieldsV1: f:metadata: f:annotations: .: {} f:velero.io/pvc-name: {} f:generateName: {} f:labels: .: {} f:velero.io/backup-name: {} f:velero.io/backup-uid: {} f:velero.io/pvc-uid: {} f:ownerReferences: .: {} k:{"uid":"84071e76-02c5-4e0f-87f3-3327c3ca3cc7"}: {} f:spec: .: {} f:backupStorageLocation: {} f:node: {} f:pod: {} f:repoIdentifier: {} f:tags: .: {} f:backup: {} f:backup-uid: {} f:ns: {} f:pod: {} f:pod-uid: {} f:pvc-uid: {} f:volume: {} f:uploaderType: {} f:volume: {} f:status: .: {} f:progress: {} manager: velero-server operation: Update time: "2026-02-05T18:43:59Z" - apiVersion: velero.io/v1 fieldsType: FieldsV1 fieldsV1: f:status: f:completionTimestamp: {} f:path: {} f:phase: {} f:progress: f:bytesDone: {} f:totalBytes: {} f:snapshotID: {} f:startTimestamp: {} manager: node-agent-server operation: Update time: "2026-02-05T18:44:07Z" name: mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8-b6dw8 namespace: openshift-adp ownerReferences: - apiVersion: velero.io/v1 controller: true kind: Backup name: mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8 uid: 84071e76-02c5-4e0f-87f3-3327c3ca3cc7 resourceVersion: "203117" uid: 2ce3cf7a-b573-4c68-98bc-a9cd8738f284 spec: backupStorageLocation: ts-dpa-1 node: ip-10-0-60-83.us-east-2.compute.internal pod: kind: Pod name: mysql-86ffb49df-9kptn namespace: test-oadp-164 uid: 1723edcb-4f9b-4050-951c-273f1230436d repoIdentifier: s3:s3-us-east-2.amazonaws.com/ci-op-988mlksm-interopoadp/velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8/restic/test-oadp-164 tags: backup: mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8 backup-uid: 84071e76-02c5-4e0f-87f3-3327c3ca3cc7 ns: test-oadp-164 pod: mysql-86ffb49df-9kptn pod-uid: 1723edcb-4f9b-4050-951c-273f1230436d pvc-uid: 248d9cb6-efe9-4202-818c-d087fd9a9f5c volume: mysql-data1 uploaderType: restic volume: mysql-data1 status: completionTimestamp: "2026-02-05T18:44:07Z" path: /host_pods/1723edcb-4f9b-4050-951c-273f1230436d/volumes/kubernetes.io~csi/pvc-248d9cb6-efe9-4202-818c-d087fd9a9f5c/mount phase: Completed progress: bytesDone: 105256269 totalBytes: 105256269 snapshotID: 7c97c130 startTimestamp: "2026-02-05T18:44:04Z" 2026/02/05 18:44:14 apiVersion: velero.io/v1 kind: PodVolumeBackup metadata: annotations: velero.io/pvc-name: mysql-data creationTimestamp: "2026-02-05T18:43:59Z" generateName: mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8- generation: 4 labels: velero.io/backup-name: mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8 velero.io/backup-uid: 84071e76-02c5-4e0f-87f3-3327c3ca3cc7 velero.io/pvc-uid: 3388bc60-4057-4d20-83db-693217cabaf7 managedFields: - apiVersion: velero.io/v1 fieldsType: FieldsV1 fieldsV1: f:metadata: f:annotations: .: {} f:velero.io/pvc-name: {} f:generateName: {} f:labels: .: {} f:velero.io/backup-name: {} f:velero.io/backup-uid: {} f:velero.io/pvc-uid: {} f:ownerReferences: .: {} k:{"uid":"84071e76-02c5-4e0f-87f3-3327c3ca3cc7"}: {} f:spec: .: {} f:backupStorageLocation: {} f:node: {} f:pod: {} f:repoIdentifier: {} f:tags: .: {} f:backup: {} f:backup-uid: {} f:ns: {} f:pod: {} f:pod-uid: {} f:pvc-uid: {} f:volume: {} f:uploaderType: {} f:volume: {} f:status: .: {} f:progress: {} manager: velero-server operation: Update time: "2026-02-05T18:43:59Z" - apiVersion: velero.io/v1 fieldsType: FieldsV1 fieldsV1: f:status: f:completionTimestamp: {} f:path: {} f:phase: {} f:progress: f:bytesDone: {} f:totalBytes: {} f:snapshotID: {} f:startTimestamp: {} manager: node-agent-server operation: Update time: "2026-02-05T18:44:01Z" name: mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8-vhz9h namespace: openshift-adp ownerReferences: - apiVersion: velero.io/v1 controller: true kind: Backup name: mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8 uid: 84071e76-02c5-4e0f-87f3-3327c3ca3cc7 resourceVersion: "203033" uid: 172b0f3b-b08b-4b09-a0ec-9f58fe77a657 spec: backupStorageLocation: ts-dpa-1 node: ip-10-0-60-83.us-east-2.compute.internal pod: kind: Pod name: mysql-86ffb49df-9kptn namespace: test-oadp-164 uid: 1723edcb-4f9b-4050-951c-273f1230436d repoIdentifier: s3:s3-us-east-2.amazonaws.com/ci-op-988mlksm-interopoadp/velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8/restic/test-oadp-164 tags: backup: mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8 backup-uid: 84071e76-02c5-4e0f-87f3-3327c3ca3cc7 ns: test-oadp-164 pod: mysql-86ffb49df-9kptn pod-uid: 1723edcb-4f9b-4050-951c-273f1230436d pvc-uid: 3388bc60-4057-4d20-83db-693217cabaf7 volume: mysql-data uploaderType: restic volume: mysql-data status: completionTimestamp: "2026-02-05T18:44:01Z" path: /host_pods/1723edcb-4f9b-4050-951c-273f1230436d/volumes/kubernetes.io~csi/pvc-3388bc60-4057-4d20-83db-693217cabaf7/mount phase: Completed progress: bytesDone: 107854713 totalBytes: 107854713 snapshotID: b5a0a667 startTimestamp: "2026-02-05T18:43:59Z" STEP: Verify backup mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8 has completed successfully @ 02/05/26 18:44:14.953 2026/02/05 18:44:14 Backup for case mysql-hooks-e2e succeeded STEP: Delete the appplication resources mysql-hooks-e2e @ 02/05/26 18:44:14.988 STEP: Cleanup Application for case mysql-hooks-e2e @ 02/05/26 18:44:14.988 2026/02/05 18:44:14 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Remove namespace test-oadp-164] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=16  changed=5  unreachable=0 failed=0 skipped=20  rescued=0 ignored=0 2026/02/05 18:44:45 2026-02-05 18:44:16,691 p=69299 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:44:16,691 p=69299 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:44:17,007 p=69299 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:44:17,007 p=69299 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:44:17,317 p=69299 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:44:17,318 p=69299 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:44:17,635 p=69299 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:44:17,636 p=69299 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:44:17,654 p=69299 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:44:17,654 p=69299 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:44:17,654 p=69299 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:44:17,674 p=69299 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:44:17,674 p=69299 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:44:17,688 p=69299 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:44:17,689 p=69299 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:44:18,121 p=69299 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:44:18,122 p=69299 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:44:18,122 p=69299 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:44:18,122 p=69299 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:44:18,150 p=69299 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:44:18,150 p=69299 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:44:18,170 p=69299 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:44:18,170 p=69299 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:44:18,173 p=69299 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:44:18,781 p=69299 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:44:18,782 p=69299 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:44:44,960 p=69299 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Remove namespace test-oadp-164] *** 2026-02-05 18:44:44,960 p=69299 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:44:44,961 p=69299 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:44:44,961 p=69299 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:44:44,961 p=69299 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:44:44,961 p=69299 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:44:45,316 p=69299 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:44:45,316 p=69299 u=1001930000 n=ansible INFO| localhost : ok=16 changed=5 unreachable=0 failed=0 skipped=20 rescued=0 ignored=0 2026/02/05 18:44:45 Creating restore mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8 for case mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8 STEP: Create restore mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8 from backup mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8 @ 02/05/26 18:44:45.375 2026/02/05 18:44:45 Wait until restore mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8 is complete restore phase: InProgress restore phase: InProgress restore phase: Finalizing restore phase: Completed 2026/02/05 18:45:25 Verify the PodVolumeBackup and PodVolumeRestore count is equal 2026/02/05 18:45:25 Verify the PodVolumeRestore is completed sucessfully and uploaderType is matching 2026/02/05 18:45:25 apiVersion: velero.io/v1 kind: PodVolumeRestore metadata: creationTimestamp: "2026-02-05T18:44:47Z" generateName: mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8- generation: 5 labels: velero.io/pod-uid: 4a5b2c19-3cb0-4659-a648-c9e534170343 velero.io/pvc-uid: 34a54890-ab45-43fc-851c-3aff260da8f4 velero.io/restore-name: mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8 velero.io/restore-uid: 4e1b677b-ca72-49a1-b31b-766b7eca425d managedFields: - apiVersion: velero.io/v1 fieldsType: FieldsV1 fieldsV1: f:metadata: f:generateName: {} f:labels: .: {} f:velero.io/pod-uid: {} f:velero.io/pvc-uid: {} f:velero.io/restore-name: {} f:velero.io/restore-uid: {} f:ownerReferences: .: {} k:{"uid":"4e1b677b-ca72-49a1-b31b-766b7eca425d"}: {} f:spec: .: {} f:backupStorageLocation: {} f:pod: {} f:repoIdentifier: {} f:snapshotID: {} f:sourceNamespace: {} f:uploaderType: {} f:volume: {} f:status: .: {} f:progress: {} manager: velero-server operation: Update time: "2026-02-05T18:44:47Z" - apiVersion: velero.io/v1 fieldsType: FieldsV1 fieldsV1: f:status: f:completionTimestamp: {} f:phase: {} f:progress: f:bytesDone: {} f:totalBytes: {} f:startTimestamp: {} manager: node-agent-server operation: Update time: "2026-02-05T18:45:08Z" name: mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8-5vqdd namespace: openshift-adp ownerReferences: - apiVersion: velero.io/v1 controller: true kind: Restore name: mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8 uid: 4e1b677b-ca72-49a1-b31b-766b7eca425d resourceVersion: "204210" uid: 96a81faa-ccaf-43db-87e8-fa491d53b360 spec: backupStorageLocation: ts-dpa-1 pod: kind: Pod name: mysql-86ffb49df-9kptn namespace: test-oadp-164 uid: 4a5b2c19-3cb0-4659-a648-c9e534170343 repoIdentifier: s3:s3-us-east-2.amazonaws.com/ci-op-988mlksm-interopoadp/velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8/restic/test-oadp-164 snapshotID: 7c97c130 sourceNamespace: test-oadp-164 uploaderType: restic volume: mysql-data1 status: completionTimestamp: "2026-02-05T18:45:08Z" phase: Completed progress: bytesDone: 105256269 totalBytes: 105256269 startTimestamp: "2026-02-05T18:45:05Z" 2026/02/05 18:45:25 apiVersion: velero.io/v1 kind: PodVolumeRestore metadata: creationTimestamp: "2026-02-05T18:44:47Z" generateName: mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8- generation: 5 labels: velero.io/pod-uid: 4a5b2c19-3cb0-4659-a648-c9e534170343 velero.io/pvc-uid: 5351c9f4-77f2-43fa-9305-a63a75315d6f velero.io/restore-name: mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8 velero.io/restore-uid: 4e1b677b-ca72-49a1-b31b-766b7eca425d managedFields: - apiVersion: velero.io/v1 fieldsType: FieldsV1 fieldsV1: f:metadata: f:generateName: {} f:labels: .: {} f:velero.io/pod-uid: {} f:velero.io/pvc-uid: {} f:velero.io/restore-name: {} f:velero.io/restore-uid: {} f:ownerReferences: .: {} k:{"uid":"4e1b677b-ca72-49a1-b31b-766b7eca425d"}: {} f:spec: .: {} f:backupStorageLocation: {} f:pod: {} f:repoIdentifier: {} f:snapshotID: {} f:sourceNamespace: {} f:uploaderType: {} f:volume: {} f:status: .: {} f:progress: {} manager: velero-server operation: Update time: "2026-02-05T18:44:47Z" - apiVersion: velero.io/v1 fieldsType: FieldsV1 fieldsV1: f:status: f:completionTimestamp: {} f:phase: {} f:progress: f:bytesDone: {} f:totalBytes: {} f:startTimestamp: {} manager: node-agent-server operation: Update time: "2026-02-05T18:45:02Z" name: mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8-vbbhm namespace: openshift-adp ownerReferences: - apiVersion: velero.io/v1 controller: true kind: Restore name: mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8 uid: 4e1b677b-ca72-49a1-b31b-766b7eca425d resourceVersion: "204114" uid: a28d2a0c-33db-467e-ba22-ed3cb98de14f spec: backupStorageLocation: ts-dpa-1 pod: kind: Pod name: mysql-86ffb49df-9kptn namespace: test-oadp-164 uid: 4a5b2c19-3cb0-4659-a648-c9e534170343 repoIdentifier: s3:s3-us-east-2.amazonaws.com/ci-op-988mlksm-interopoadp/velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8/restic/test-oadp-164 snapshotID: b5a0a667 sourceNamespace: test-oadp-164 uploaderType: restic volume: mysql-data status: completionTimestamp: "2026-02-05T18:45:02Z" phase: Completed progress: bytesDone: 107854713 totalBytes: 107854713 startTimestamp: "2026-02-05T18:45:00Z" STEP: Verify restore mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8has completed successfully @ 02/05/26 18:45:25.462 STEP: Verify Application restore @ 02/05/26 18:45:25.465 STEP: Verify Application deployment for case mysql-hooks-e2e @ 02/05/26 18:45:25.465 2026/02/05 18:45:25 Using admin kubeconfig for with_validate operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check mysql pod status] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Query the inserted data] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Validate test1 file has correct md5 hash] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=19  changed=7  unreachable=0 failed=0 skipped=17  rescued=0 ignored=0 2026/02/05 18:45:32 2026-02-05 18:45:27,152 p=69528 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:45:27,152 p=69528 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:45:27,467 p=69528 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:45:27,467 p=69528 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:45:27,784 p=69528 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:45:27,784 p=69528 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:45:28,104 p=69528 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:45:28,104 p=69528 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:45:28,122 p=69528 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:45:28,123 p=69528 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:45:28,123 p=69528 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:45:28,144 p=69528 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:45:28,144 p=69528 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:45:28,159 p=69528 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:45:28,160 p=69528 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:45:28,585 p=69528 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:45:28,586 p=69528 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:45:28,586 p=69528 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:45:28,586 p=69528 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:45:28,615 p=69528 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:45:28,615 p=69528 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:45:28,636 p=69528 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:45:28,636 p=69528 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:45:28,639 p=69528 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:45:29,245 p=69528 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:45:29,245 p=69528 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:45:30,585 p=69528 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Check mysql pod status] *** 2026-02-05 18:45:30,585 p=69528 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:45:30,586 p=69528 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:45:30,586 p=69528 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:45:30,586 p=69528 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:45:30,586 p=69528 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:45:31,050 p=69528 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Wait until service ready for connections] *** 2026-02-05 18:45:31,050 p=69528 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:45:31,560 p=69528 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Query the inserted data] *** 2026-02-05 18:45:31,561 p=69528 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:45:32,202 p=69528 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Validate test1 file has correct md5 hash] *** 2026-02-05 18:45:32,203 p=69528 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:45:32,207 p=69528 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:45:32,208 p=69528 u=1001930000 n=ansible INFO| localhost : ok=19 changed=7 unreachable=0 failed=0 skipped=17 rescued=0 ignored=0 2026/02/05 18:45:32 stderr: ERROR 1049 (42000): Unknown database 'world' < Exit [It] [tc-id:OADP-164][interop][smoke] [Tier0] MySQL app with Restic @ 02/05/26 18:45:32.33 (2m55.762s) > Enter [JustAfterEach] TOP-LEVEL @ 02/05/26 18:45:32.33 2026/02/05 18:45:32 Using Must-gather image: registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 Secret deletion flag: true Deleting cloud credentials secret cloud-credentials in namespace openshift-adp < Exit [JustAfterEach] TOP-LEVEL @ 02/05/26 18:45:32.338 (8ms) > Enter [DeferCleanup (Each)] Successful Init hook @ 02/05/26 18:45:32.338 < Exit [DeferCleanup (Each)] Successful Init hook @ 02/05/26 18:45:32.341 (3ms) > Enter [DeferCleanup (Each)] Successful Init hook @ 02/05/26 18:45:32.341 < Exit [DeferCleanup (Each)] Successful Init hook @ 02/05/26 18:45:32.341 (0s) > Enter [DeferCleanup (Each)] Successful Init hook @ 02/05/26 18:45:32.341 2026/02/05 18:45:32 Cleaning app 2026/02/05 18:45:32 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Remove namespace test-oadp-164] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=16  changed=5  unreachable=0 failed=0 skipped=20  rescued=0 ignored=0 2026/02/05 18:46:02 2026-02-05 18:45:34,038 p=69854 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:45:34,038 p=69854 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:45:34,352 p=69854 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:45:34,353 p=69854 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:45:34,667 p=69854 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:45:34,667 p=69854 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:45:34,982 p=69854 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:45:34,982 p=69854 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:45:35,000 p=69854 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:45:35,000 p=69854 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:45:35,001 p=69854 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:45:35,021 p=69854 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:45:35,021 p=69854 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:45:35,035 p=69854 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:45:35,036 p=69854 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:45:35,466 p=69854 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:45:35,466 p=69854 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:45:35,467 p=69854 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:45:35,467 p=69854 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:45:35,495 p=69854 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:45:35,495 p=69854 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:45:35,516 p=69854 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:45:35,516 p=69854 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:45:35,519 p=69854 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:45:36,121 p=69854 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:45:36,121 p=69854 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:46:02,271 p=69854 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-mysql : Remove namespace test-oadp-164] *** 2026-02-05 18:46:02,271 p=69854 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:46:02,271 p=69854 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:46:02,272 p=69854 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:46:02,272 p=69854 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:46:02,272 p=69854 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:46:02,636 p=69854 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:46:02,636 p=69854 u=1001930000 n=ansible INFO| localhost : ok=16 changed=5 unreachable=0 failed=0 skipped=20 rescued=0 ignored=0 < Exit [DeferCleanup (Each)] Successful Init hook @ 02/05/26 18:46:02.693 (30.352s) > Enter [DeferCleanup (Each)] Successful Init hook @ 02/05/26 18:46:02.693 2026/02/05 18:46:02 Cleaning setup resources for the backup < Exit [DeferCleanup (Each)] Successful Init hook @ 02/05/26 18:46:02.693 (0s) > Enter [DeferCleanup (Each)] Successful Init hook @ 02/05/26 18:46:02.693 2026/02/05 18:46:02 Deleting DPA CR < Exit [DeferCleanup (Each)] Successful Init hook @ 02/05/26 18:46:02.702 (9ms) • [206.141 seconds] ------------------------------ SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS ------------------------------ Incremental backup restore tests Incremental restore pod count [tc-id:OADP-165][interop] [Tier0] [vf:restore-policies] Todolist app with CSI - policy: update /alabama/cspi/e2e/incremental_restore/backup_restore_incremental.go:94 > Enter [BeforeEach] TOP-LEVEL @ 02/05/26 18:46:02.702 < Exit [BeforeEach] TOP-LEVEL @ 02/05/26 18:46:02.702 (0s) > Enter [BeforeEach] Incremental backup restore tests @ 02/05/26 18:46:02.702 < Exit [BeforeEach] Incremental backup restore tests @ 02/05/26 18:46:02.708 (6ms) > Enter [JustBeforeEach] TOP-LEVEL @ 02/05/26 18:46:02.708 < Exit [JustBeforeEach] TOP-LEVEL @ 02/05/26 18:46:02.708 (0s) > Enter [It] [tc-id:OADP-165][interop] [Tier0] [vf:restore-policies] Todolist app with CSI - policy: update @ 02/05/26 18:46:02.709 2026/02/05 18:46:02 Delete all downloadrequest No download requests are found STEP: Create DPA CR @ 02/05/26 18:46:02.711 2026/02/05 18:46:02 csi 2026/02/05 18:46:02 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "1900f5b7-f866-43bf-9a4e-ca08dcd6e2a5", "resourceVersion": "205077", "generation": 1, "creationTimestamp": "2026-02-05T18:46:02Z", "managedFields": [ { "manager": "e2e.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T18:46:02Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false } }, "features": null, "logFormat": "text" }, "status": {} } Delete all the backups that remained in the phase InProgress Deleting backup CRs in progress Deletion of backup CRs in progress completed Delete all the restores that remained in the phase InProgress Deleting restore CRs in progress Deletion of restore CRs in progress completed STEP: Verify DPA CR setup @ 02/05/26 18:46:02.778 2026/02/05 18:46:02 Waiting for velero pod to be running 2026/02/05 18:46:02 Wait for DPA status.condition.reason to be 'Completed' and and message to be 'Reconcile complete' 2026/02/05 18:46:02 { "metadata": { "name": "ts-dpa", "namespace": "openshift-adp", "uid": "1900f5b7-f866-43bf-9a4e-ca08dcd6e2a5", "resourceVersion": "205077", "generation": 1, "creationTimestamp": "2026-02-05T18:46:02Z", "managedFields": [ { "manager": "e2e.test", "operation": "Update", "apiVersion": "oadp.openshift.io/v1alpha1", "time": "2026-02-05T18:46:02Z", "fieldsType": "FieldsV1", "fieldsV1": { "f:spec": { ".": {}, "f:backupLocations": {}, "f:configuration": { ".": {}, "f:velero": { ".": {}, "f:defaultPlugins": {}, "f:disableFsBackup": {} } }, "f:logFormat": {}, "f:podDnsConfig": {}, "f:snapshotLocations": {} } } } ] }, "spec": { "backupLocations": [ { "velero": { "provider": "aws", "config": { "region": "us-east-2" }, "credential": { "name": "cloud-credentials", "key": "cloud" }, "objectStorage": { "bucket": "ci-op-988mlksm-interopoadp", "prefix": "velero-e2e-b9c95639-02b2-11f1-a139-0a58ac1896e8" }, "default": true } } ], "snapshotLocations": [], "podDnsConfig": {}, "configuration": { "velero": { "defaultPlugins": [ "openshift", "aws", "kubevirt", "hypershift", "csi" ], "disableFsBackup": false } }, "features": null, "logFormat": "text" }, "status": {} } 2026/02/05 18:46:07 DPA successfully reconciled STEP: Installing application for case todolist-backup @ 02/05/26 18:46:07.807 2026/02/05 18:46:07 🔄 [Attempt 1/3] Executing operation: Deploy application ocp-todolist-mariadb 2026/02/05 18:46:07 Using admin kubeconfig for with_deploy operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Check namespace todolist-mariadb-csi-policy-update] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Create namespace todolist-mariadb-csi-policy-update] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Ensure namespace todolist-mariadb-csi-policy-update is present] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Deploy todolist-mysql application] *** changed: [localhost] FAILED - RETRYING: [localhost]: Check mysql pod status (30 retries left). FAILED - RETRYING: [localhost]: Check mysql pod status (29 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Check mysql pod status] *** ok: [localhost] FAILED - RETRYING: [localhost]: Check todolist pod status (30 retries left). FAILED - RETRYING: [localhost]: Check todolist pod status (29 retries left). FAILED - RETRYING: [localhost]: Check todolist pod status (28 retries left). FAILED - RETRYING: [localhost]: Check todolist pod status (27 retries left). TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Check todolist pod status] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Wait until service is ready for connections] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Wait until todolist API server starts] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Add additional items todo list] *** changed: [localhost] Pausing for 30 seconds TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Wait for 30 seconds] *** ok: [localhost] PLAY RECAP ********************************************************************* localhost : ok=25  changed=9  unreachable=0 failed=0 skipped=4  rescued=0 ignored=0 2026/02/05 18:47:12 2026-02-05 18:46:09,499 p=70082 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:46:09,499 p=70082 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:46:09,816 p=70082 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:46:09,816 p=70082 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:46:10,128 p=70082 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:46:10,128 p=70082 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:46:10,440 p=70082 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:46:10,440 p=70082 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:46:10,458 p=70082 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:46:10,458 p=70082 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:46:10,458 p=70082 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:46:10,479 p=70082 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:46:10,479 p=70082 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:46:10,494 p=70082 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:46:10,494 p=70082 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:46:10,926 p=70082 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:46:10,927 p=70082 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:46:10,927 p=70082 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:46:10,927 p=70082 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:46:10,955 p=70082 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:46:10,955 p=70082 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:46:10,975 p=70082 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:46:10,975 p=70082 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:46:10,978 p=70082 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:46:11,581 p=70082 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:46:11,581 p=70082 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:46:12,699 p=70082 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Check namespace todolist-mariadb-csi-policy-update] *** 2026-02-05 18:46:12,699 p=70082 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:46:12,700 p=70082 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:46:12,700 p=70082 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:46:12,700 p=70082 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:46:12,700 p=70082 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:46:13,111 p=70082 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Create namespace todolist-mariadb-csi-policy-update] *** 2026-02-05 18:46:13,111 p=70082 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:46:14,055 p=70082 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Ensure namespace todolist-mariadb-csi-policy-update is present] *** 2026-02-05 18:46:14,056 p=70082 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:46:15,466 p=70082 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Deploy todolist-mysql application] *** 2026-02-05 18:46:15,467 p=70082 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:46:16,426 p=70082 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check mysql pod status (30 retries left). 2026-02-05 18:46:20,356 p=70082 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check mysql pod status (29 retries left). 2026-02-05 18:46:24,289 p=70082 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Check mysql pod status] *** 2026-02-05 18:46:24,290 p=70082 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:46:25,304 p=70082 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check todolist pod status (30 retries left). 2026-02-05 18:46:29,216 p=70082 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check todolist pod status (29 retries left). 2026-02-05 18:46:33,156 p=70082 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check todolist pod status (28 retries left). 2026-02-05 18:46:37,051 p=70082 u=1001930000 n=ansible INFO| FAILED - RETRYING: [localhost]: Check todolist pod status (27 retries left). 2026-02-05 18:46:40,961 p=70082 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Check todolist pod status] *** 2026-02-05 18:46:40,962 p=70082 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:46:41,360 p=70082 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Wait until service is ready for connections] *** 2026-02-05 18:46:41,360 p=70082 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:46:41,747 p=70082 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Wait until todolist API server starts] *** 2026-02-05 18:46:41,747 p=70082 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:46:42,219 p=70082 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Add additional items todo list] *** 2026-02-05 18:46:42,220 p=70082 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:46:42,240 p=70082 u=1001930000 n=ansible INFO| Pausing for 30 seconds 2026-02-05 18:47:12,244 p=70082 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Wait for 30 seconds] *** 2026-02-05 18:47:12,244 p=70082 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:47:12,268 p=70082 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:47:12,268 p=70082 u=1001930000 n=ansible INFO| localhost : ok=25 changed=9 unreachable=0 failed=0 skipped=4 rescued=0 ignored=0 STEP: Verify Application deployment @ 02/05/26 18:47:12.325 2026/02/05 18:47:12 Using admin kubeconfig for with_validate operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Validating todolist] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb/tasks/validation_task.yml for localhost [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Check mysql pod is running] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Wait until mysql service ready for connections] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Check todolist pod is running] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Wait until todolist API server starts] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Obtain todolist route] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Find 1st database item] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Find the string in incomplete items] *** ok: [localhost] PLAY RECAP ********************************************************************* localhost : ok=23  changed=6  unreachable=0 failed=0 skipped=13  rescued=0 ignored=0 2026/02/05 18:47:21 2026-02-05 18:47:14,023 p=70564 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:47:14,023 p=70564 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:47:14,344 p=70564 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:47:14,344 p=70564 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:47:14,666 p=70564 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:47:14,666 p=70564 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:47:14,981 p=70564 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:47:14,982 p=70564 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:47:15,000 p=70564 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:47:15,000 p=70564 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:47:15,000 p=70564 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:47:15,020 p=70564 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:47:15,021 p=70564 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:47:15,035 p=70564 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:47:15,035 p=70564 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:47:15,456 p=70564 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:47:15,457 p=70564 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:47:15,457 p=70564 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:47:15,457 p=70564 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:47:15,484 p=70564 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:47:15,484 p=70564 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:47:15,505 p=70564 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:47:15,505 p=70564 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:47:15,509 p=70564 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:47:16,104 p=70564 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:47:16,105 p=70564 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:47:16,364 p=70564 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Validating todolist] *** 2026-02-05 18:47:16,377 p=70564 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb/tasks/validation_task.yml for localhost 2026-02-05 18:47:17,501 p=70564 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Check mysql pod is running] *** 2026-02-05 18:47:17,502 p=70564 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:47:17,502 p=70564 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:47:17,502 p=70564 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:47:17,502 p=70564 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:47:17,503 p=70564 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:47:17,894 p=70564 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Wait until mysql service ready for connections] *** 2026-02-05 18:47:17,895 p=70564 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:47:18,843 p=70564 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Check todolist pod is running] *** 2026-02-05 18:47:18,844 p=70564 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:47:19,230 p=70564 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Wait until todolist API server starts] *** 2026-02-05 18:47:19,230 p=70564 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:47:20,348 p=70564 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Obtain todolist route] *** 2026-02-05 18:47:20,349 p=70564 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:47:20,810 p=70564 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Find 1st database item] *** 2026-02-05 18:47:20,810 p=70564 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:47:21,147 p=70564 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Find the string in incomplete items] *** 2026-02-05 18:47:21,147 p=70564 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:47:21,151 p=70564 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:47:21,151 p=70564 u=1001930000 n=ansible INFO| localhost : ok=23 changed=6 unreachable=0 failed=0 skipped=13 rescued=0 ignored=0 STEP: Prepare backup resources, depending on the volumes backup type @ 02/05/26 18:47:21.214 Run the command: oc get ns openshift-storage &> /dev/null && echo true || echo false 2026/02/05 18:47:21 The 'openshift-storage' namespace exists 2026/02/05 18:47:21 Checking default storage class count 2026/02/05 18:47:21 Using the CSI driver: openshift-storage.rbd.csi.ceph.com 2026/02/05 18:47:21 Snapclass 'example-snapclass' doesn't exist, creating 2026/02/05 18:47:21 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 18:47:21 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2026/02/05 18:47:21 {{ } { } [{{ } {mysql todolist-mariadb-csi-policy-update c956fc77-6d8f-4fea-917b-37b77df214a2 205457 0 2026-02-05 18:46:15 +0000 UTC map[app:mysql] map[pv.kubernetes.io/bind-completed:yes pv.kubernetes.io/bound-by-controller:yes reclaimspace.csiaddons.openshift.io/cronjob:mysql-1770317175 reclaimspace.csiaddons.openshift.io/schedule:@weekly volume.beta.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com volume.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com] [] [kubernetes.io/pvc-protection] [{OpenAPI-Generator Update v1 2026-02-05 18:46:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:app":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}} } {csi-addons-manager Update v1 2026-02-05 18:46:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:reclaimspace.csiaddons.openshift.io/cronjob":{},"f:reclaimspace.csiaddons.openshift.io/schedule":{}}}} } {kube-controller-manager Update v1 2026-02-05 18:46:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:pv.kubernetes.io/bind-completed":{},"f:pv.kubernetes.io/bound-by-controller":{},"f:volume.beta.kubernetes.io/storage-provisioner":{},"f:volume.kubernetes.io/storage-provisioner":{}}},"f:spec":{"f:volumeName":{}}} } {kube-controller-manager Update v1 2026-02-05 18:46:15 +0000 UTC FieldsV1 {"f:status":{"f:accessModes":{},"f:capacity":{".":{},"f:storage":{}},"f:phase":{}}} status}]} {[ReadWriteOnce] nil {map[] map[storage:{{1073741824 0} {} 1Gi BinarySI}]} pvc-c956fc77-6d8f-4fea-917b-37b77df214a2 0xc000c82510 0xc000c82520 nil nil } {Bound [ReadWriteOnce] map[storage:{{1073741824 0} {} 1Gi BinarySI}] [] map[] map[] nil}}]} STEP: Creating backup todolist-backup-1a8737c8-02c3-11f1-a139-0a58ac1896e8 @ 02/05/26 18:47:21.436 2026/02/05 18:47:21 Wait until backup todolist-backup-1a8737c8-02c3-11f1-a139-0a58ac1896e8 is completed backup phase: Completed 2026/02/05 18:47:41 Verify the Backup has CSIVolumeSnapshotsAttempted and CSIVolumeSnapshotsCompleted field on status 2026/02/05 18:47:41 Run velero describe on the backup 2026/02/05 18:47:41 [./velero describe backup todolist-backup-1a8737c8-02c3-11f1-a139-0a58ac1896e8 -n openshift-adp --details --insecure-skip-tls-verify] 2026/02/05 18:47:41 Exec stderr: "" 2026/02/05 18:47:41 Name: todolist-backup-1a8737c8-02c3-11f1-a139-0a58ac1896e8 Namespace: openshift-adp Labels: velero.io/storage-location=ts-dpa-1 Annotations: velero.io/resource-timeout=10m0s velero.io/source-cluster-k8s-gitversion=v1.34.2 velero.io/source-cluster-k8s-major-version=1 velero.io/source-cluster-k8s-minor-version=34 Phase: Completed Namespaces: Included: todolist-mariadb-csi-policy-update Excluded: Resources: Included: * Excluded: Cluster-scoped: auto Label selector: Or label selector: Storage Location: ts-dpa-1 Velero-Native Snapshot PVs: auto File System Backup (Default): false Snapshot Move Data: false Data Mover: velero TTL: 720h0m0s CSISnapshotTimeout: 10m0s ItemOperationTimeout: 4h0m0s Hooks: Backup Format Version: 1.1.0 Started: 2026-02-05 18:47:21 +0000 UTC Completed: 2026-02-05 18:47:29 +0000 UTC Expiration: 2026-03-07 18:47:21 +0000 UTC Total items to be backed up: 65 Items backed up: 65 Backup Item Operations: Operation for volumesnapshots.snapshot.storage.k8s.io todolist-mariadb-csi-policy-update/velero-mysql-f84c6: Backup Item Action Plugin: velero.io/csi-volumesnapshot-backupper Operation ID: todolist-mariadb-csi-policy-update/velero-mysql-f84c6/2026-02-05T18:47:28Z Items to Update: volumesnapshots.snapshot.storage.k8s.io todolist-mariadb-csi-policy-update/velero-mysql-f84c6 volumesnapshotcontents.snapshot.storage.k8s.io /snapcontent-99afc592-e4a5-4abb-8e37-17dd540b503d Phase: Completed Created: 2026-02-05 18:47:28 +0000 UTC Started: 2026-02-05 18:47:28 +0000 UTC Updated: 2026-02-05 18:47:28 +0000 UTC Resource List: apiextensions.k8s.io/v1/CustomResourceDefinition: - reclaimspacecronjobs.csiaddons.openshift.io - securitycontextconstraints.security.openshift.io apps/v1/Deployment: - todolist-mariadb-csi-policy-update/mysql - todolist-mariadb-csi-policy-update/todolist apps/v1/ReplicaSet: - todolist-mariadb-csi-policy-update/mysql-797d9d567c - todolist-mariadb-csi-policy-update/todolist-68c796448d authorization.openshift.io/v1/RoleBinding: - todolist-mariadb-csi-policy-update/admin - todolist-mariadb-csi-policy-update/system:deployers - todolist-mariadb-csi-policy-update/system:image-builders - todolist-mariadb-csi-policy-update/system:image-pullers csiaddons.openshift.io/v1alpha1/ReclaimSpaceCronJob: - todolist-mariadb-csi-policy-update/mysql-1770317175 discovery.k8s.io/v1/EndpointSlice: - todolist-mariadb-csi-policy-update/mysql-59pqc - todolist-mariadb-csi-policy-update/todolist-k9ld9 rbac.authorization.k8s.io/v1/RoleBinding: - todolist-mariadb-csi-policy-update/admin - todolist-mariadb-csi-policy-update/system:deployers - todolist-mariadb-csi-policy-update/system:image-builders - todolist-mariadb-csi-policy-update/system:image-pullers route.openshift.io/v1/Route: - todolist-mariadb-csi-policy-update/todolist-route security.openshift.io/v1/SecurityContextConstraints: - todolist-mariadb-csi-policy-update-scc snapshot.storage.k8s.io/v1/VolumeSnapshot: - todolist-mariadb-csi-policy-update/velero-mysql-f84c6 snapshot.storage.k8s.io/v1/VolumeSnapshotClass: - example-snapclass snapshot.storage.k8s.io/v1/VolumeSnapshotContent: - snapcontent-99afc592-e4a5-4abb-8e37-17dd540b503d v1/ConfigMap: - todolist-mariadb-csi-policy-update/kube-root-ca.crt - todolist-mariadb-csi-policy-update/openshift-service-ca.crt v1/Endpoints: - todolist-mariadb-csi-policy-update/mysql - todolist-mariadb-csi-policy-update/todolist v1/Event: - todolist-mariadb-csi-policy-update/mysql-797d9d567c-zq82b.18916e1765e2f9a7 - todolist-mariadb-csi-policy-update/mysql-797d9d567c-zq82b.18916e1773a357e1 - todolist-mariadb-csi-policy-update/mysql-797d9d567c-zq82b.18916e177548fd08 - todolist-mariadb-csi-policy-update/mysql-797d9d567c-zq82b.18916e17982c6009 - todolist-mariadb-csi-policy-update/mysql-797d9d567c-zq82b.18916e18cba1f2ee - todolist-mariadb-csi-policy-update/mysql-797d9d567c-zq82b.18916e18ccdcaece - todolist-mariadb-csi-policy-update/mysql-797d9d567c-zq82b.18916e18d1d30fd3 - todolist-mariadb-csi-policy-update/mysql-797d9d567c-zq82b.18916e18d250ee0f - todolist-mariadb-csi-policy-update/mysql-797d9d567c.18916e1765c7afb7 - todolist-mariadb-csi-policy-update/mysql.18916e17610d94ce - todolist-mariadb-csi-policy-update/mysql.18916e17615a860d - todolist-mariadb-csi-policy-update/mysql.18916e17647dfe67 - todolist-mariadb-csi-policy-update/mysql.18916e1773988fd8 - todolist-mariadb-csi-policy-update/todolist-68c796448d-rw8vw.18916e176a5296f3 - todolist-mariadb-csi-policy-update/todolist-68c796448d-rw8vw.18916e179395353b - todolist-mariadb-csi-policy-update/todolist-68c796448d-rw8vw.18916e1794d5995e - todolist-mariadb-csi-policy-update/todolist-68c796448d-rw8vw.18916e1798f54718 - todolist-mariadb-csi-policy-update/todolist-68c796448d-rw8vw.18916e17997ff79a - todolist-mariadb-csi-policy-update/todolist-68c796448d-rw8vw.18916e1cd12c9f98 - todolist-mariadb-csi-policy-update/todolist-68c796448d-rw8vw.18916e1d12e17f8b - todolist-mariadb-csi-policy-update/todolist-68c796448d-rw8vw.18916e1d1750ce66 - todolist-mariadb-csi-policy-update/todolist-68c796448d-rw8vw.18916e1d17c8f8b8 - todolist-mariadb-csi-policy-update/todolist-68c796448d.18916e17698f5536 - todolist-mariadb-csi-policy-update/todolist.18916e176857cafb v1/Namespace: - todolist-mariadb-csi-policy-update v1/PersistentVolume: - pvc-c956fc77-6d8f-4fea-917b-37b77df214a2 v1/PersistentVolumeClaim: - todolist-mariadb-csi-policy-update/mysql v1/Pod: - todolist-mariadb-csi-policy-update/mysql-797d9d567c-zq82b - todolist-mariadb-csi-policy-update/todolist-68c796448d-rw8vw v1/Secret: - todolist-mariadb-csi-policy-update/builder-dockercfg-8v5p8 - todolist-mariadb-csi-policy-update/default-dockercfg-tnn4j - todolist-mariadb-csi-policy-update/deployer-dockercfg-mmb6p - todolist-mariadb-csi-policy-update/todolist-mariadb-csi-policy-update-sa-dockercfg-lxpv4 v1/Service: - todolist-mariadb-csi-policy-update/mysql - todolist-mariadb-csi-policy-update/todolist v1/ServiceAccount: - todolist-mariadb-csi-policy-update/builder - todolist-mariadb-csi-policy-update/default - todolist-mariadb-csi-policy-update/deployer - todolist-mariadb-csi-policy-update/todolist-mariadb-csi-policy-update-sa Backup Volumes: Velero-Native Snapshots: CSI Snapshots: todolist-mariadb-csi-policy-update/mysql: Snapshot: Operation ID: todolist-mariadb-csi-policy-update/velero-mysql-f84c6/2026-02-05T18:47:28Z Snapshot Content Name: snapcontent-99afc592-e4a5-4abb-8e37-17dd540b503d Storage Snapshot ID: 0001-0011-openshift-storage-0000000000000003-0398d9e6-b1dd-45d8-b949-f9294e49dc85 Snapshot Size (bytes): 1073741824 CSI Driver: openshift-storage.rbd.csi.ceph.com Result: succeeded Pod Volume Backups: HooksAttempted: 0 HooksFailed: 0 STEP: Verify backup todolist-backup-1a8737c8-02c3-11f1-a139-0a58ac1896e8 has completed successfully @ 02/05/26 18:47:41.936 2026/02/05 18:47:41 Backup for case todolist-backup succeeded STEP: Scale application @ 02/05/26 18:47:41.987 2026/02/05 18:47:41 Scaling deployment 'todolist' to 2 replicas 2026/02/05 18:47:42 Deployment updated successfully 2026/02/05 18:47:42 number of running pods: 1 2026/02/05 18:47:47 number of running pods: 1 2026/02/05 18:47:52 Application reached target number of replicas: 2 STEP: Prepare backup resources, depending on the volumes backup type @ 02/05/26 18:47:52.058 Run the command: oc get ns openshift-storage &> /dev/null && echo true || echo false 2026/02/05 18:47:52 The 'openshift-storage' namespace exists 2026/02/05 18:47:52 Checking default storage class count 2026/02/05 18:47:52 Using the CSI driver: openshift-storage.rbd.csi.ceph.com 2026/02/05 18:47:52 Snapclass 'example-snapclass' already exists, skip creating 2026/02/05 18:47:52 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 18:47:52 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2026/02/05 18:47:52 {{ } { } [{{ } {mysql todolist-mariadb-csi-policy-update c956fc77-6d8f-4fea-917b-37b77df214a2 206470 0 2026-02-05 18:46:15 +0000 UTC map[app:mysql] map[pv.kubernetes.io/bind-completed:yes pv.kubernetes.io/bound-by-controller:yes reclaimspace.csiaddons.openshift.io/cronjob:mysql-1770317175 reclaimspace.csiaddons.openshift.io/schedule:@weekly volume.beta.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com volume.kubernetes.io/storage-provisioner:openshift-storage.rbd.csi.ceph.com] [] [kubernetes.io/pvc-protection] [{OpenAPI-Generator Update v1 2026-02-05 18:46:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:app":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}} } {csi-addons-manager Update v1 2026-02-05 18:46:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:reclaimspace.csiaddons.openshift.io/cronjob":{},"f:reclaimspace.csiaddons.openshift.io/schedule":{}}}} } {kube-controller-manager Update v1 2026-02-05 18:46:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:pv.kubernetes.io/bind-completed":{},"f:pv.kubernetes.io/bound-by-controller":{},"f:volume.beta.kubernetes.io/storage-provisioner":{},"f:volume.kubernetes.io/storage-provisioner":{}}},"f:spec":{"f:volumeName":{}}} } {kube-controller-manager Update v1 2026-02-05 18:46:15 +0000 UTC FieldsV1 {"f:status":{"f:accessModes":{},"f:capacity":{".":{},"f:storage":{}},"f:phase":{}}} status}]} {[ReadWriteOnce] nil {map[] map[storage:{{1073741824 0} {} 1Gi BinarySI}]} pvc-c956fc77-6d8f-4fea-917b-37b77df214a2 0xc000439e60 0xc000439e70 nil nil } {Bound [ReadWriteOnce] map[storage:{{1073741824 0} {} 1Gi BinarySI}] [] map[] map[] nil}}]} STEP: Creating backup todolist-backup-2ce9b9d5-02c3-11f1-a139-0a58ac1896e8 @ 02/05/26 18:47:52.198 2026/02/05 18:47:52 Wait until backup todolist-backup-2ce9b9d5-02c3-11f1-a139-0a58ac1896e8 is completed backup phase: Completed 2026/02/05 18:48:12 Verify the Backup has CSIVolumeSnapshotsAttempted and CSIVolumeSnapshotsCompleted field on status 2026/02/05 18:48:12 Run velero describe on the backup 2026/02/05 18:48:12 [./velero describe backup todolist-backup-2ce9b9d5-02c3-11f1-a139-0a58ac1896e8 -n openshift-adp --details --insecure-skip-tls-verify] 2026/02/05 18:48:12 Exec stderr: "" 2026/02/05 18:48:12 Name: todolist-backup-2ce9b9d5-02c3-11f1-a139-0a58ac1896e8 Namespace: openshift-adp Labels: velero.io/storage-location=ts-dpa-1 Annotations: velero.io/resource-timeout=10m0s velero.io/source-cluster-k8s-gitversion=v1.34.2 velero.io/source-cluster-k8s-major-version=1 velero.io/source-cluster-k8s-minor-version=34 Phase: Completed Namespaces: Included: todolist-mariadb-csi-policy-update Excluded: Resources: Included: * Excluded: Cluster-scoped: auto Label selector: Or label selector: Storage Location: ts-dpa-1 Velero-Native Snapshot PVs: auto File System Backup (Default): false Snapshot Move Data: false Data Mover: velero TTL: 720h0m0s CSISnapshotTimeout: 10m0s ItemOperationTimeout: 4h0m0s Hooks: Backup Format Version: 1.1.0 Started: 2026-02-05 18:47:52 +0000 UTC Completed: 2026-02-05 18:47:59 +0000 UTC Expiration: 2026-03-07 18:47:52 +0000 UTC Total items to be backed up: 81 Items backed up: 81 Backup Item Operations: Operation for volumesnapshots.snapshot.storage.k8s.io todolist-mariadb-csi-policy-update/velero-mysql-vqq7c: Backup Item Action Plugin: velero.io/csi-volumesnapshot-backupper Operation ID: todolist-mariadb-csi-policy-update/velero-mysql-vqq7c/2026-02-05T18:47:58Z Items to Update: volumesnapshots.snapshot.storage.k8s.io todolist-mariadb-csi-policy-update/velero-mysql-vqq7c volumesnapshotcontents.snapshot.storage.k8s.io /snapcontent-2936bdf0-475a-407f-a888-5a8bdcbe7af6 Phase: Completed Created: 2026-02-05 18:47:58 +0000 UTC Started: 2026-02-05 18:47:58 +0000 UTC Updated: 2026-02-05 18:47:58 +0000 UTC Resource List: apiextensions.k8s.io/v1/CustomResourceDefinition: - reclaimspacecronjobs.csiaddons.openshift.io - securitycontextconstraints.security.openshift.io apps/v1/Deployment: - todolist-mariadb-csi-policy-update/mysql - todolist-mariadb-csi-policy-update/todolist apps/v1/ReplicaSet: - todolist-mariadb-csi-policy-update/mysql-797d9d567c - todolist-mariadb-csi-policy-update/todolist-68c796448d authorization.openshift.io/v1/RoleBinding: - todolist-mariadb-csi-policy-update/admin - todolist-mariadb-csi-policy-update/system:deployers - todolist-mariadb-csi-policy-update/system:image-builders - todolist-mariadb-csi-policy-update/system:image-pullers csiaddons.openshift.io/v1alpha1/ReclaimSpaceCronJob: - todolist-mariadb-csi-policy-update/mysql-1770317175 discovery.k8s.io/v1/EndpointSlice: - todolist-mariadb-csi-policy-update/mysql-59pqc - todolist-mariadb-csi-policy-update/todolist-k9ld9 rbac.authorization.k8s.io/v1/RoleBinding: - todolist-mariadb-csi-policy-update/admin - todolist-mariadb-csi-policy-update/system:deployers - todolist-mariadb-csi-policy-update/system:image-builders - todolist-mariadb-csi-policy-update/system:image-pullers route.openshift.io/v1/Route: - todolist-mariadb-csi-policy-update/todolist-route security.openshift.io/v1/SecurityContextConstraints: - todolist-mariadb-csi-policy-update-scc snapshot.storage.k8s.io/v1/VolumeSnapshot: - todolist-mariadb-csi-policy-update/velero-mysql-vqq7c snapshot.storage.k8s.io/v1/VolumeSnapshotClass: - example-snapclass snapshot.storage.k8s.io/v1/VolumeSnapshotContent: - snapcontent-2936bdf0-475a-407f-a888-5a8bdcbe7af6 v1/ConfigMap: - todolist-mariadb-csi-policy-update/kube-root-ca.crt - todolist-mariadb-csi-policy-update/openshift-service-ca.crt v1/Endpoints: - todolist-mariadb-csi-policy-update/mysql - todolist-mariadb-csi-policy-update/todolist v1/Event: - todolist-mariadb-csi-policy-update/mysql-797d9d567c-zq82b.18916e1765e2f9a7 - todolist-mariadb-csi-policy-update/mysql-797d9d567c-zq82b.18916e1773a357e1 - todolist-mariadb-csi-policy-update/mysql-797d9d567c-zq82b.18916e177548fd08 - todolist-mariadb-csi-policy-update/mysql-797d9d567c-zq82b.18916e17982c6009 - todolist-mariadb-csi-policy-update/mysql-797d9d567c-zq82b.18916e18cba1f2ee - todolist-mariadb-csi-policy-update/mysql-797d9d567c-zq82b.18916e18ccdcaece - todolist-mariadb-csi-policy-update/mysql-797d9d567c-zq82b.18916e18d1d30fd3 - todolist-mariadb-csi-policy-update/mysql-797d9d567c-zq82b.18916e18d250ee0f - todolist-mariadb-csi-policy-update/mysql-797d9d567c.18916e1765c7afb7 - todolist-mariadb-csi-policy-update/mysql.18916e17610d94ce - todolist-mariadb-csi-policy-update/mysql.18916e17615a860d - todolist-mariadb-csi-policy-update/mysql.18916e17647dfe67 - todolist-mariadb-csi-policy-update/mysql.18916e1773988fd8 - todolist-mariadb-csi-policy-update/todolist-68c796448d-l7sx7.18916e2b984f3e02 - todolist-mariadb-csi-policy-update/todolist-68c796448d-l7sx7.18916e2bbffa081b - todolist-mariadb-csi-policy-update/todolist-68c796448d-l7sx7.18916e2bc2b48cbe - todolist-mariadb-csi-policy-update/todolist-68c796448d-l7sx7.18916e2d268511da - todolist-mariadb-csi-policy-update/todolist-68c796448d-l7sx7.18916e2d2aef0b28 - todolist-mariadb-csi-policy-update/todolist-68c796448d-l7sx7.18916e2d2b60df14 - todolist-mariadb-csi-policy-update/todolist-68c796448d-l7sx7.18916e2d58d52abf - todolist-mariadb-csi-policy-update/todolist-68c796448d-l7sx7.18916e2d928c7361 - todolist-mariadb-csi-policy-update/todolist-68c796448d-l7sx7.18916e2d977aef98 - todolist-mariadb-csi-policy-update/todolist-68c796448d-l7sx7.18916e2d97f0b0e0 - todolist-mariadb-csi-policy-update/todolist-68c796448d-rw8vw.18916e176a5296f3 - todolist-mariadb-csi-policy-update/todolist-68c796448d-rw8vw.18916e179395353b - todolist-mariadb-csi-policy-update/todolist-68c796448d-rw8vw.18916e1794d5995e - todolist-mariadb-csi-policy-update/todolist-68c796448d-rw8vw.18916e1798f54718 - todolist-mariadb-csi-policy-update/todolist-68c796448d-rw8vw.18916e17997ff79a - todolist-mariadb-csi-policy-update/todolist-68c796448d-rw8vw.18916e1cd12c9f98 - todolist-mariadb-csi-policy-update/todolist-68c796448d-rw8vw.18916e1d12e17f8b - todolist-mariadb-csi-policy-update/todolist-68c796448d-rw8vw.18916e1d1750ce66 - todolist-mariadb-csi-policy-update/todolist-68c796448d-rw8vw.18916e1d17c8f8b8 - todolist-mariadb-csi-policy-update/todolist-68c796448d.18916e17698f5536 - todolist-mariadb-csi-policy-update/todolist-68c796448d.18916e2b97ad039e - todolist-mariadb-csi-policy-update/todolist.18916e176857cafb - todolist-mariadb-csi-policy-update/todolist.18916e2b95df4de8 - todolist-mariadb-csi-policy-update/velero-mysql-f84c6.18916e272f853333 - todolist-mariadb-csi-policy-update/velero-mysql-f84c6.18916e27ba842bed - todolist-mariadb-csi-policy-update/velero-mysql-f84c6.18916e27ba8490c9 v1/Namespace: - todolist-mariadb-csi-policy-update v1/PersistentVolume: - pvc-c956fc77-6d8f-4fea-917b-37b77df214a2 v1/PersistentVolumeClaim: - todolist-mariadb-csi-policy-update/mysql v1/Pod: - todolist-mariadb-csi-policy-update/mysql-797d9d567c-zq82b - todolist-mariadb-csi-policy-update/todolist-68c796448d-l7sx7 - todolist-mariadb-csi-policy-update/todolist-68c796448d-rw8vw v1/Secret: - todolist-mariadb-csi-policy-update/builder-dockercfg-8v5p8 - todolist-mariadb-csi-policy-update/default-dockercfg-tnn4j - todolist-mariadb-csi-policy-update/deployer-dockercfg-mmb6p - todolist-mariadb-csi-policy-update/todolist-mariadb-csi-policy-update-sa-dockercfg-lxpv4 v1/Service: - todolist-mariadb-csi-policy-update/mysql - todolist-mariadb-csi-policy-update/todolist v1/ServiceAccount: - todolist-mariadb-csi-policy-update/builder - todolist-mariadb-csi-policy-update/default - todolist-mariadb-csi-policy-update/deployer - todolist-mariadb-csi-policy-update/todolist-mariadb-csi-policy-update-sa Backup Volumes: Velero-Native Snapshots: CSI Snapshots: todolist-mariadb-csi-policy-update/mysql: Snapshot: Operation ID: todolist-mariadb-csi-policy-update/velero-mysql-vqq7c/2026-02-05T18:47:58Z Snapshot Content Name: snapcontent-2936bdf0-475a-407f-a888-5a8bdcbe7af6 Storage Snapshot ID: 0001-0011-openshift-storage-0000000000000003-24998d9e-943a-491f-ab52-2b3513b088d3 Snapshot Size (bytes): 1073741824 CSI Driver: openshift-storage.rbd.csi.ceph.com Result: succeeded Pod Volume Backups: HooksAttempted: 0 HooksFailed: 0 STEP: Verify backup todolist-backup-2ce9b9d5-02c3-11f1-a139-0a58ac1896e8 has completed successfully @ 02/05/26 18:48:12.836 2026/02/05 18:48:12 Backup for case todolist-backup succeeded STEP: Cleanup application and restore 1st backup @ 02/05/26 18:48:12.921 STEP: Delete the appplication resources todolist-backup @ 02/05/26 18:48:12.921 STEP: Cleanup Application for case todolist-backup @ 02/05/26 18:48:12.921 2026/02/05 18:48:12 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Remove namespace todolist-mariadb-csi-policy-update] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Remove todolist-mariadb-csi-policy-update SCC] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=17  changed=6  unreachable=0 failed=0 skipped=12  rescued=0 ignored=0 2026/02/05 18:48:44 2026-02-05 18:48:14,611 p=70952 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:48:14,611 p=70952 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:48:14,931 p=70952 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:48:14,931 p=70952 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:48:15,250 p=70952 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:48:15,250 p=70952 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:48:15,570 p=70952 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:48:15,571 p=70952 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:48:15,588 p=70952 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:48:15,589 p=70952 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:48:15,589 p=70952 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:48:15,609 p=70952 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:48:15,609 p=70952 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:48:15,624 p=70952 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:48:15,624 p=70952 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:48:16,058 p=70952 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:48:16,058 p=70952 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:48:16,058 p=70952 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:48:16,059 p=70952 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:48:16,086 p=70952 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:48:16,087 p=70952 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:48:16,107 p=70952 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:48:16,107 p=70952 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:48:16,111 p=70952 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:48:16,713 p=70952 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:48:16,713 p=70952 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:48:42,871 p=70952 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Remove namespace todolist-mariadb-csi-policy-update] *** 2026-02-05 18:48:42,871 p=70952 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:48:42,872 p=70952 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:48:42,872 p=70952 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:48:42,872 p=70952 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:48:42,872 p=70952 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:48:44,168 p=70952 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Remove todolist-mariadb-csi-policy-update SCC] *** 2026-02-05 18:48:44,169 p=70952 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:48:44,369 p=70952 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:48:44,369 p=70952 u=1001930000 n=ansible INFO| localhost : ok=17 changed=6 unreachable=0 failed=0 skipped=12 rescued=0 ignored=0 2026/02/05 18:48:44 Creating restore todolist-backup-1a8737c8-02c3-11f1-a139-0a58ac1896e8 for case todolist-backup-1a8737c8-02c3-11f1-a139-0a58ac1896e8 STEP: Create restore todolist-backup-1a8737c8-02c3-11f1-a139-0a58ac1896e8 from backup todolist-backup-1a8737c8-02c3-11f1-a139-0a58ac1896e8 @ 02/05/26 18:48:44.425 2026/02/05 18:48:44 Wait until restore todolist-backup-1a8737c8-02c3-11f1-a139-0a58ac1896e8 is complete restore phase: Finalizing restore phase: Completed STEP: Verify restore todolist-backup-1a8737c8-02c3-11f1-a139-0a58ac1896e8has completed successfully @ 02/05/26 18:49:04.46 STEP: Verify Application restore @ 02/05/26 18:49:04.463 STEP: Verify Application deployment for case todolist-backup @ 02/05/26 18:49:04.463 2026/02/05 18:49:04 Using admin kubeconfig for with_validate operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Validating todolist] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb/tasks/validation_task.yml for localhost [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Check mysql pod is running] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Wait until mysql service ready for connections] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Check todolist pod is running] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Wait until todolist API server starts] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Obtain todolist route] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Find 1st database item] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Find the string in incomplete items] *** ok: [localhost] PLAY RECAP ********************************************************************* localhost : ok=23  changed=6  unreachable=0 failed=0 skipped=13  rescued=0 ignored=0 2026/02/05 18:49:13 2026-02-05 18:49:06,170 p=71186 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:49:06,170 p=71186 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:49:06,489 p=71186 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:49:06,490 p=71186 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:49:06,811 p=71186 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:49:06,811 p=71186 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:49:07,128 p=71186 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:49:07,128 p=71186 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:49:07,146 p=71186 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:49:07,147 p=71186 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:49:07,147 p=71186 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:49:07,167 p=71186 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:49:07,167 p=71186 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:49:07,181 p=71186 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:49:07,182 p=71186 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:49:07,605 p=71186 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:49:07,606 p=71186 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:49:07,606 p=71186 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:49:07,606 p=71186 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:49:07,633 p=71186 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:49:07,633 p=71186 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:49:07,654 p=71186 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:49:07,654 p=71186 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:49:07,657 p=71186 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:49:08,267 p=71186 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:49:08,267 p=71186 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:49:08,526 p=71186 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Validating todolist] *** 2026-02-05 18:49:08,538 p=71186 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb/tasks/validation_task.yml for localhost 2026-02-05 18:49:09,655 p=71186 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Check mysql pod is running] *** 2026-02-05 18:49:09,655 p=71186 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:49:09,656 p=71186 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:49:09,656 p=71186 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:49:09,656 p=71186 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:49:09,656 p=71186 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:49:10,042 p=71186 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Wait until mysql service ready for connections] *** 2026-02-05 18:49:10,043 p=71186 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:49:11,005 p=71186 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Check todolist pod is running] *** 2026-02-05 18:49:11,006 p=71186 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:49:11,372 p=71186 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Wait until todolist API server starts] *** 2026-02-05 18:49:11,372 p=71186 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:49:12,585 p=71186 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Obtain todolist route] *** 2026-02-05 18:49:12,585 p=71186 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:49:13,048 p=71186 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Find 1st database item] *** 2026-02-05 18:49:13,048 p=71186 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:49:13,395 p=71186 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Find the string in incomplete items] *** 2026-02-05 18:49:13,396 p=71186 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:49:13,400 p=71186 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:49:13,400 p=71186 u=1001930000 n=ansible INFO| localhost : ok=23 changed=6 unreachable=0 failed=0 skipped=13 rescued=0 ignored=0 2026/02/05 18:49:13 Application reached target number of replicas: 1 STEP: Restore 2nd backup with existingRessourcePolicy: update @ 02/05/26 18:49:13.463 2026/02/05 18:49:13 Creating restore todolist-backup-2ce9b9d5-02c3-11f1-a139-0a58ac1896e8 for case todolist-backup-2ce9b9d5-02c3-11f1-a139-0a58ac1896e8 STEP: Create restore todolist-backup-2ce9b9d5-02c3-11f1-a139-0a58ac1896e8 from backup todolist-backup-2ce9b9d5-02c3-11f1-a139-0a58ac1896e8 @ 02/05/26 18:49:13.463 2026/02/05 18:49:13 Wait until restore todolist-backup-2ce9b9d5-02c3-11f1-a139-0a58ac1896e8 is complete restore phase: Completed STEP: Verify restore todolist-backup-2ce9b9d5-02c3-11f1-a139-0a58ac1896e8has completed successfully @ 02/05/26 18:49:23.502 STEP: Verify Application restore @ 02/05/26 18:49:23.506 STEP: Verify Application deployment for case todolist-backup @ 02/05/26 18:49:23.506 2026/02/05 18:49:23 Using admin kubeconfig for with_validate operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Validating todolist] *** included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb/tasks/validation_task.yml for localhost [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Check mysql pod is running] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Wait until mysql service ready for connections] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Check todolist pod is running] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Wait until todolist API server starts] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Obtain todolist route] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Find 1st database item] *** ok: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Find the string in incomplete items] *** ok: [localhost] PLAY RECAP ********************************************************************* localhost : ok=23  changed=6  unreachable=0 failed=0 skipped=13  rescued=0 ignored=0 2026/02/05 18:49:32 2026-02-05 18:49:25,222 p=71534 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:49:25,222 p=71534 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:49:25,542 p=71534 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:49:25,542 p=71534 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:49:25,860 p=71534 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:49:25,860 p=71534 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:49:26,183 p=71534 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:49:26,183 p=71534 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:49:26,200 p=71534 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:49:26,201 p=71534 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:49:26,201 p=71534 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:49:26,220 p=71534 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:49:26,221 p=71534 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:49:26,235 p=71534 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:49:26,235 p=71534 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:49:26,673 p=71534 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:49:26,674 p=71534 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:49:26,674 p=71534 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:49:26,674 p=71534 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:49:26,703 p=71534 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:49:26,703 p=71534 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:49:26,725 p=71534 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:49:26,725 p=71534 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:49:26,728 p=71534 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:49:27,340 p=71534 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:49:27,340 p=71534 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:49:27,603 p=71534 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Validating todolist] *** 2026-02-05 18:49:27,615 p=71534 u=1001930000 n=ansible INFO| included: /alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb/tasks/validation_task.yml for localhost 2026-02-05 18:49:28,710 p=71534 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Check mysql pod is running] *** 2026-02-05 18:49:28,711 p=71534 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:49:28,711 p=71534 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:49:28,711 p=71534 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:49:28,712 p=71534 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:49:28,712 p=71534 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:49:29,087 p=71534 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Wait until mysql service ready for connections] *** 2026-02-05 18:49:29,087 p=71534 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:49:30,053 p=71534 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Check todolist pod is running] *** 2026-02-05 18:49:30,054 p=71534 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:49:30,420 p=71534 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Wait until todolist API server starts] *** 2026-02-05 18:49:30,420 p=71534 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:49:31,528 p=71534 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Obtain todolist route] *** 2026-02-05 18:49:31,529 p=71534 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:49:32,007 p=71534 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Find 1st database item] *** 2026-02-05 18:49:32,008 p=71534 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:49:32,345 p=71534 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Find the string in incomplete items] *** 2026-02-05 18:49:32,345 p=71534 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:49:32,350 p=71534 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:49:32,350 p=71534 u=1001930000 n=ansible INFO| localhost : ok=23 changed=6 unreachable=0 failed=0 skipped=13 rescued=0 ignored=0 2026/02/05 18:49:32 Application reached target number of replicas: 2 < Exit [It] [tc-id:OADP-165][interop] [Tier0] [vf:restore-policies] Todolist app with CSI - policy: update @ 02/05/26 18:49:32.42 (3m29.712s) > Enter [JustAfterEach] TOP-LEVEL @ 02/05/26 18:49:32.421 2026/02/05 18:49:32 Using Must-gather image: registry.redhat.io/oadp/oadp-mustgather-rhel9:1.5.3 Secret deletion flag: true Deleting cloud credentials secret cloud-credentials in namespace openshift-adp < Exit [JustAfterEach] TOP-LEVEL @ 02/05/26 18:49:32.429 (8ms) > Enter [DeferCleanup (Each)] Incremental restore pod count @ 02/05/26 18:49:32.429 < Exit [DeferCleanup (Each)] Incremental restore pod count @ 02/05/26 18:49:32.432 (3ms) > Enter [DeferCleanup (Each)] Incremental restore pod count @ 02/05/26 18:49:32.432 < Exit [DeferCleanup (Each)] Incremental restore pod count @ 02/05/26 18:49:32.434 (2ms) > Enter [DeferCleanup (Each)] Incremental restore pod count @ 02/05/26 18:49:32.434 < Exit [DeferCleanup (Each)] Incremental restore pod count @ 02/05/26 18:49:32.434 (0s) > Enter [DeferCleanup (Each)] Incremental restore pod count @ 02/05/26 18:49:32.434 2026/02/05 18:49:32 Cleaning setup resources for the backup 2026/02/05 18:49:32 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 18:49:32 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd 2026/02/05 18:49:32 Deleting VolumeSnapshotClass 'example-snapclass' < Exit [DeferCleanup (Each)] Incremental restore pod count @ 02/05/26 18:49:32.45 (16ms) > Enter [DeferCleanup (Each)] Incremental restore pod count @ 02/05/26 18:49:32.45 < Exit [DeferCleanup (Each)] Incremental restore pod count @ 02/05/26 18:49:32.45 (0s) > Enter [DeferCleanup (Each)] Incremental restore pod count @ 02/05/26 18:49:32.45 2026/02/05 18:49:32 Cleaning setup resources for the backup 2026/02/05 18:49:32 Setting new default StorageClass 'odf-operator-ceph-rbd' 2026/02/05 18:49:32 Checking default storage class count Skipping creation of StorageClass The current StorageClass: odf-operator-ceph-rbd matches the new StorageClass: odf-operator-ceph-rbd < Exit [DeferCleanup (Each)] Incremental restore pod count @ 02/05/26 18:49:32.545 (94ms) > Enter [DeferCleanup (Each)] Incremental restore pod count @ 02/05/26 18:49:32.545 2026/02/05 18:49:32 Cleaning app 2026/02/05 18:49:32 Using admin kubeconfig for with_cleanup operation: /home/jenkins/.kube/config [WARNING]: No inventory was parsed, only implicit localhost is available [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all' [WARNING]: Found variable using reserved name 'namespace'. Origin:   namespace  PLAY [localhost] *************************************************************** TASK [Gathering Facts] ********************************************************* ok: [localhost] TASK [include_vars] ************************************************************ ok: [localhost] TASK [Print admin kubeconfig path] ********************************************* ok: [localhost] => {  "msg": "Admin KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Print user kubeconfig path] ********************************************** ok: [localhost] => {  "msg": "User KUBECONFIG path: /home/jenkins/.kube/config" } TASK [Remove all the contents from the file] *********************************** changed: [localhost] TASK [Get cluster endpoint (from admin kubeconfig)] **************************** changed: [localhost] TASK [Get admin token] ********************************************************* changed: [localhost] TASK [Get user token] ********************************************************** changed: [localhost] [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9  35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}"  ^ column 9  TASK [Set core facts (admin + user token)] ************************************* ok: [localhost] TASK [Choose token based on non_admin flag] ************************************ ok: [localhost] TASK [Print token] ************************************************************* ok: [localhost] => {  "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. TASK [Extract Kubernetes minor version from cluster] *************************** ok: [localhost] TASK [Map Kubernetes minor to OCP release] ************************************* ok: [localhost] TASK [set_fact] **************************************************************** ok: [localhost] PLAY [Execute Task] ************************************************************ TASK [Gathering Facts] ********************************************************* ok: [localhost] [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Remove namespace todolist-mariadb-csi-policy-update] *** changed: [localhost] TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Remove todolist-mariadb-csi-policy-update SCC] *** changed: [localhost] PLAY RECAP ********************************************************************* localhost : ok=17  changed=6  unreachable=0 failed=0 skipped=12  rescued=0 ignored=0 2026/02/05 18:50:04 2026-02-05 18:49:34,245 p=71879 u=1001930000 n=ansible INFO| TASK [Remove all the contents from the file] *********************************** 2026-02-05 18:49:34,246 p=71879 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:49:34,563 p=71879 u=1001930000 n=ansible INFO| TASK [Get cluster endpoint (from admin kubeconfig)] **************************** 2026-02-05 18:49:34,564 p=71879 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:49:34,884 p=71879 u=1001930000 n=ansible INFO| TASK [Get admin token] ********************************************************* 2026-02-05 18:49:34,884 p=71879 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:49:35,201 p=71879 u=1001930000 n=ansible INFO| TASK [Get user token] ********************************************************** 2026-02-05 18:49:35,201 p=71879 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:49:35,219 p=71879 u=1001930000 n=ansible WARNING| [WARNING]: Found variable using reserved name 'namespace'. Origin: /alabama/cspi/sample-applications/ansible/main.yml:37:9 35 set_fact: 36 oc_binary: "oc" 37 namespace: "{{ use_role }}" ^ column 9 2026-02-05 18:49:35,219 p=71879 u=1001930000 n=ansible INFO| TASK [Set core facts (admin + user token)] ************************************* 2026-02-05 18:49:35,219 p=71879 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:49:35,239 p=71879 u=1001930000 n=ansible INFO| TASK [Choose token based on non_admin flag] ************************************ 2026-02-05 18:49:35,239 p=71879 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:49:35,254 p=71879 u=1001930000 n=ansible INFO| TASK [Print token] ************************************************************* 2026-02-05 18:49:35,254 p=71879 u=1001930000 n=ansible INFO| ok: [localhost] => { "msg": "Token: sha256~NlJS95Qo9jngqJoLnNYEzBLfpC5kz75hCyyUD7TuS1U" } 2026-02-05 18:49:35,684 p=71879 u=1001930000 n=ansible INFO| TASK [Extract Kubernetes minor version from cluster] *************************** 2026-02-05 18:49:35,684 p=71879 u=1001930000 n=ansible WARNING| [WARNING]: Deprecation warnings can be disabled by setting `deprecation_warnings=False` in ansible.cfg. 2026-02-05 18:49:35,685 p=71879 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: The `ansible.module_utils.common._collections_compat` module is deprecated. This feature will be removed from ansible-core version 2.24. Use `collections.abc` from the Python standard library instead. 2026-02-05 18:49:35,685 p=71879 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:49:35,713 p=71879 u=1001930000 n=ansible INFO| TASK [Map Kubernetes minor to OCP release] ************************************* 2026-02-05 18:49:35,714 p=71879 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:49:35,735 p=71879 u=1001930000 n=ansible INFO| TASK [set_fact] **************************************************************** 2026-02-05 18:49:35,735 p=71879 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:49:35,738 p=71879 u=1001930000 n=ansible INFO| PLAY [Execute Task] ************************************************************ 2026-02-05 18:49:36,340 p=71879 u=1001930000 n=ansible INFO| TASK [Gathering Facts] ********************************************************* 2026-02-05 18:49:36,340 p=71879 u=1001930000 n=ansible INFO| ok: [localhost] 2026-02-05 18:50:02,513 p=71879 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Remove namespace todolist-mariadb-csi-policy-update] *** 2026-02-05 18:50:02,514 p=71879 u=1001930000 n=ansible WARNING| [WARNING]: kubernetes<24.2.0 is not supported or tested. Some features may not work. 2026-02-05 18:50:02,514 p=71879 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_native' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:50:02,514 p=71879 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_bytes' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:50:02,515 p=71879 u=1001930000 n=ansible INFO| [DEPRECATION WARNING]: Importing 'to_text' from 'ansible.module_utils._text' is deprecated. This feature will be removed from ansible-core version 2.24. Use ansible.module_utils.common.text.converters instead. 2026-02-05 18:50:02,515 p=71879 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:50:03,768 p=71879 u=1001930000 n=ansible INFO| TASK [/alabama/cspi/sample-applications/ocpdeployer/ansible/roles/ocp-todolist-mariadb : Remove todolist-mariadb-csi-policy-update SCC] *** 2026-02-05 18:50:03,768 p=71879 u=1001930000 n=ansible INFO| changed: [localhost] 2026-02-05 18:50:03,968 p=71879 u=1001930000 n=ansible INFO| PLAY RECAP ********************************************************************* 2026-02-05 18:50:03,968 p=71879 u=1001930000 n=ansible INFO| localhost : ok=17 changed=6 unreachable=0 failed=0 skipped=12 rescued=0 ignored=0 < Exit [DeferCleanup (Each)] Incremental restore pod count @ 02/05/26 18:50:04.025 (31.48s) > Enter [DeferCleanup (Each)] Incremental restore pod count @ 02/05/26 18:50:04.025 2026/02/05 18:50:04 Deleting DPA CR < Exit [DeferCleanup (Each)] Incremental restore pod count @ 02/05/26 18:50:04.031 (7ms) • [241.329 seconds] ------------------------------ SSSSSSSSSSSSSSS ------------------------------ [SynchronizedAfterSuite]  /alabama/cspi/e2e/e2e_suite_test.go:229 > Enter [SynchronizedAfterSuite] TOP-LEVEL @ 02/05/26 18:50:04.032 < Exit [SynchronizedAfterSuite] TOP-LEVEL @ 02/05/26 18:50:04.032 (0s) > Enter [SynchronizedAfterSuite] TOP-LEVEL @ 02/05/26 18:50:04.032 < Exit [SynchronizedAfterSuite] TOP-LEVEL @ 02/05/26 18:50:04.032 (0s) [SynchronizedAfterSuite] PASSED [0.000 seconds] ------------------------------ [ReportAfterSuite] Autogenerated ReportAfterSuite for --junit-report autogenerated by Ginkgo > Enter [ReportAfterSuite] TOP-LEVEL @ 02/05/26 18:50:04.032 < Exit [ReportAfterSuite] TOP-LEVEL @ 02/05/26 18:50:04.049 (17ms) [ReportAfterSuite] PASSED [0.017 seconds] ------------------------------ Summarizing 2 Failures: [FAIL] Backup hooks tests Pre exec hook [It] [tc-id:OADP-92][interop][smoke] [Tier0] [vf:backup-hooks] Cassandra app with Restic /alabama/cspi/test_common/backup_restore_app_case.go:49 [FAIL] [datamover] DataMover: Backup/Restore stateful application with CSI  [It] [tc-id:OADP-440][interop] [Tier0] [vf:data-mover] Cassandra application /alabama/cspi/test_common/backup_restore_app_case.go:49 Ran 9 of 228 Specs in 7197.083 seconds FAIL! -- 7 Passed | 2 Failed | 0 Pending | 219 Skipped --- FAIL: TestOADPE2E (7197.12s) FAIL Ginkgo ran 1 suite in 2h0m16.753147944s Test Suite Failed [must-gather ] OUT 2026-02-05T18:50:34.163429876Z Using must-gather plug-in image: registry.redhat.io/oadp/oadp-mustgather-rhel9:v1.4 When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: a6a8f0b0-37da-44fd-82f5-3da5ab2e0e09 ClientVersion: 4.20.11 ClusterVersion: Stable at "4.21.0-0.nightly-2026-02-04-232248" ClusterOperators: clusteroperator/operator-lifecycle-manager is not upgradeable because ClusterServiceVersions blocking minor version upgrades to 4.22.0 or higher: - maximum supported OCP version for openshift-storage/odf-dependencies.v4.20.5-rhodf is 4.21 - maximum supported OCP version for openshift-storage/odf-operator.v4.20.5-rhodf is 4.21 [must-gather ] OUT 2026-02-05T18:50:34.193629142Z namespace/openshift-must-gather-jt4xj created [must-gather ] OUT 2026-02-05T18:50:34.200444663Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-jxhq2 created [must-gather ] OUT 2026-02-05T18:50:34.237921884Z pod for plug-in image registry.redhat.io/oadp/oadp-mustgather-rhel9:v1.4 created [must-gather-x9k62] POD 2026-02-05T18:50:44.107470112Z [disk usage checker] Started [must-gather-x9k62] POD 2026-02-05T18:50:44.112062900Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:50:44.965230997Z W0205 18:50:44.965175 3 warnings.go:70] apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather-x9k62] POD 2026-02-05T18:50:45.013250824Z W0205 18:50:45.013213 3 warnings.go:70] kubevirt.io/v1 VirtualMachineInstancePresets is now deprecated and will be removed in v2. [must-gather-x9k62] POD 2026-02-05T18:50:45.496925193Z W0205 18:50:45.496877 3 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather-x9k62] POD 2026-02-05T18:50:48.580020914Z W0205 18:50:48.579972 3 warnings.go:70] apps.openshift.io/v1 DeploymentConfig is deprecated in v4.14+, unavailable in v4.10000+ [must-gather-x9k62] POD 2026-02-05T18:50:48.618962488Z W0205 18:50:48.618918 3 warnings.go:70] kubevirt.io/v1 VirtualMachineInstancePresets is now deprecated and will be removed in v2. [must-gather-x9k62] POD 2026-02-05T18:50:49.118143176Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:50:49.187684265Z W0205 18:50:49.187628 3 warnings.go:70] v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice [must-gather-x9k62] POD 2026-02-05T18:50:54.124416659Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:50:59.130681690Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:50:59.782636140Z download request download url timeout, check velero server logs for errors. backup storage location may not be available [must-gather-x9k62] POD 2026-02-05T18:51:04.137138228Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:51:09.142151943Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:51:09.784179927Z download request download url timeout, check velero server logs for errors. backup storage location may not be available [must-gather-x9k62] POD 2026-02-05T18:51:14.147877280Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:51:19.152922008Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:51:19.786603519Z download request download url timeout, check velero server logs for errors. backup storage location may not be available [must-gather-x9k62] POD 2026-02-05T18:51:24.158537829Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:51:29.163404076Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:51:29.788049259Z download request download url timeout, check velero server logs for errors. backup storage location may not be available [must-gather-x9k62] POD 2026-02-05T18:51:34.168814519Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:51:39.174138304Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:51:39.789932323Z download request download url timeout, check velero server logs for errors. backup storage location may not be available [must-gather-x9k62] POD 2026-02-05T18:51:44.179362527Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:51:49.185195398Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:51:49.791560463Z download request download url timeout, check velero server logs for errors. backup storage location may not be available [must-gather-x9k62] POD 2026-02-05T18:51:54.190799201Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:51:59.196439675Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:51:59.793739108Z download request download url timeout, check velero server logs for errors. backup storage location may not be available [must-gather-x9k62] POD 2026-02-05T18:52:04.202120109Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:52:09.207691490Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:52:09.795396364Z download request download url timeout, check velero server logs for errors. backup storage location may not be available [must-gather-x9k62] POD 2026-02-05T18:52:14.213603674Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:52:19.218872733Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:52:19.803695573Z download request download url timeout, check velero server logs for errors. backup storage location may not be available [must-gather-x9k62] POD 2026-02-05T18:52:24.225159139Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:52:29.231125573Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:52:29.805497934Z Get "https://172.30.0.1:443/apis/velero.io/v1/namespaces/openshift-adp/downloadrequests/empty-project-e2e-3c7cac45-02c2-11f1-a139-0a58ac1896e8-d5b7b371-3b4b-4f6c-8443-9a8c3a974e30": context deadline exceeded [must-gather-x9k62] POD 2026-02-05T18:52:34.236768756Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:52:39.242185403Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:52:39.806486920Z Get "https://172.30.0.1:443/apis/velero.io/v1/namespaces/openshift-adp/downloadrequests/mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8-35124e4b-cadd-43f6-a8de-354143f5b66a": context deadline exceeded [must-gather-x9k62] POD 2026-02-05T18:52:44.247780754Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:52:49.252637874Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:52:49.809114311Z download request download url timeout, check velero server logs for errors. backup storage location may not be available [must-gather-x9k62] POD 2026-02-05T18:52:54.257670320Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:52:59.264239829Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:52:59.810440598Z download request download url timeout, check velero server logs for errors. backup storage location may not be available [must-gather-x9k62] POD 2026-02-05T18:53:04.270327169Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:53:09.275822693Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:53:09.812150173Z download request download url timeout, check velero server logs for errors. backup storage location may not be available [must-gather-x9k62] POD 2026-02-05T18:53:14.281430239Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:53:19.287822018Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:53:19.813399150Z download request download url timeout, check velero server logs for errors. backup storage location may not be available [must-gather-x9k62] POD 2026-02-05T18:53:24.293031496Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:53:29.299023025Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:53:29.817498802Z Get "https://172.30.0.1:443/apis/velero.io/v1/namespaces/openshift-adp/downloadrequests/todolist-backup-1a8737c8-02c3-11f1-a139-0a58ac1896e8-14ff3150-5485-42e7-861c-8af937d897f3": context deadline exceeded [must-gather-x9k62] POD 2026-02-05T18:53:34.304212845Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:53:39.310073264Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:53:39.819374564Z download request download url timeout, check velero server logs for errors. backup storage location may not be available [must-gather-x9k62] POD 2026-02-05T18:53:40.140650413Z Caches written to disk [must-gather-x9k62] POD 2026-02-05T18:53:39.310073264Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:53:39.819374564Z download request download url timeout, check velero server logs for errors. backup storage location may not be available [must-gather-x9k62] POD 2026-02-05T18:53:40.140650413Z Caches written to disk [must-gather-x9k62] POD 2026-02-05T18:53:39.310073264Z [disk usage checker] Volume usage percentage: current = 21 ; allowed = 70 [must-gather-x9k62] POD 2026-02-05T18:53:39.819374564Z download request download url timeout, check velero server logs for errors. backup storage location may not be available [must-gather-x9k62] POD 2026-02-05T18:53:40.140650413Z Caches written to disk [must-gather-x9k62] OUT 2026-02-05T18:53:41.194558276Z waiting for gather to complete [must-gather-x9k62] OUT 2026-02-05T18:53:41.199370618Z downloading gather output [must-gather-x9k62] OUT 2026-02-05T18:53:41.467955433Z receiving incremental file list [must-gather-x9k62] OUT 2026-02-05T18:53:41.485857668Z ./ [must-gather-x9k62] OUT 2026-02-05T18:53:41.485947143Z version [must-gather-x9k62] OUT 2026-02-05T18:53:41.505091326Z clusters/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.505123747Z clusters/a6a8f0b0/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.505292176Z clusters/a6a8f0b0/event-filter.html [must-gather-x9k62] OUT 2026-02-05T18:53:41.507947551Z clusters/a6a8f0b0/oadp-must-gather-summary.md [must-gather-x9k62] OUT 2026-02-05T18:53:41.508180574Z clusters/a6a8f0b0/timestamp [must-gather-x9k62] OUT 2026-02-05T18:53:41.50829131Z clusters/a6a8f0b0/cluster-scoped-resources/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.508307501Z clusters/a6a8f0b0/cluster-scoped-resources/apiextensions.k8s.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.508314961Z clusters/a6a8f0b0/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.508363924Z clusters/a6a8f0b0/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/backuprepositories.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.508538113Z clusters/a6a8f0b0/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/backups.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.508792167Z clusters/a6a8f0b0/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/backupstoragelocations.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.508953616Z clusters/a6a8f0b0/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/cloudstorages.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.509119565Z clusters/a6a8f0b0/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/clusterserviceversions.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.511731947Z clusters/a6a8f0b0/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/datadownloads.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.512011742Z clusters/a6a8f0b0/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/dataprotectionapplications.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.512693479Z clusters/a6a8f0b0/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/datauploads.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.512854428Z clusters/a6a8f0b0/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/deletebackuprequests.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.512989545Z clusters/a6a8f0b0/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/downloadrequests.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.513152224Z clusters/a6a8f0b0/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/podvolumebackups.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.513338415Z clusters/a6a8f0b0/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/podvolumerestores.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.513505053Z clusters/a6a8f0b0/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/restores.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.513740756Z clusters/a6a8f0b0/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/schedules.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.51398077Z clusters/a6a8f0b0/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/serverstatusrequests.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.514134208Z clusters/a6a8f0b0/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/subscriptions.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.514979784Z clusters/a6a8f0b0/cluster-scoped-resources/apiextensions.k8s.io/customresourcedefinitions/volumesnapshotlocations.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.515062969Z clusters/a6a8f0b0/cluster-scoped-resources/config.openshift.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.515140673Z clusters/a6a8f0b0/cluster-scoped-resources/config.openshift.io/clusterversions.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.51526756Z clusters/a6a8f0b0/cluster-scoped-resources/snapshot.storage.k8s.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.515283141Z clusters/a6a8f0b0/cluster-scoped-resources/snapshot.storage.k8s.io/volumesnapshotclasses/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.515345554Z clusters/a6a8f0b0/cluster-scoped-resources/snapshot.storage.k8s.io/volumesnapshotclasses/volumesnapshotclasses.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.51544889Z clusters/a6a8f0b0/cluster-scoped-resources/storage.k8s.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.51545903Z clusters/a6a8f0b0/cluster-scoped-resources/storage.k8s.io/csidrivers/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.515512853Z clusters/a6a8f0b0/cluster-scoped-resources/storage.k8s.io/csidrivers/csidrivers.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.515595247Z clusters/a6a8f0b0/cluster-scoped-resources/storage.k8s.io/storageclasses/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.515665271Z clusters/a6a8f0b0/cluster-scoped-resources/storage.k8s.io/storageclasses/storageclasses.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.515770007Z clusters/a6a8f0b0/namespaces/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.515777567Z clusters/a6a8f0b0/namespaces/openshift-adp/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.515844091Z clusters/a6a8f0b0/namespaces/openshift-adp/openshift-adp.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.515926696Z clusters/a6a8f0b0/namespaces/openshift-adp/apps.openshift.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.515997339Z clusters/a6a8f0b0/namespaces/openshift-adp/apps.openshift.io/deploymentconfigs.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.516065753Z clusters/a6a8f0b0/namespaces/openshift-adp/apps/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.516147797Z clusters/a6a8f0b0/namespaces/openshift-adp/apps/daemonsets.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.516305156Z clusters/a6a8f0b0/namespaces/openshift-adp/apps/deployments.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.516517237Z clusters/a6a8f0b0/namespaces/openshift-adp/apps/replicasets.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.516696657Z clusters/a6a8f0b0/namespaces/openshift-adp/apps/statefulsets.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.516757261Z clusters/a6a8f0b0/namespaces/openshift-adp/autoscaling/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.516829885Z clusters/a6a8f0b0/namespaces/openshift-adp/autoscaling/horizontalpodautoscalers.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.516910759Z clusters/a6a8f0b0/namespaces/openshift-adp/batch/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.516972012Z clusters/a6a8f0b0/namespaces/openshift-adp/batch/cronjobs.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.517094759Z clusters/a6a8f0b0/namespaces/openshift-adp/batch/jobs.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.517190704Z clusters/a6a8f0b0/namespaces/openshift-adp/build.openshift.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.517305791Z clusters/a6a8f0b0/namespaces/openshift-adp/build.openshift.io/buildconfigs.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.517427407Z clusters/a6a8f0b0/namespaces/openshift-adp/build.openshift.io/builds.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.51748845Z clusters/a6a8f0b0/namespaces/openshift-adp/cdi.kubevirt.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.517557174Z clusters/a6a8f0b0/namespaces/openshift-adp/cdi.kubevirt.io/dataimportcrons.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.517684531Z clusters/a6a8f0b0/namespaces/openshift-adp/cdi.kubevirt.io/datasources.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.517804258Z clusters/a6a8f0b0/namespaces/openshift-adp/cdi.kubevirt.io/datavolumes.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.517873102Z clusters/a6a8f0b0/namespaces/openshift-adp/clone.kubevirt.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.517941235Z clusters/a6a8f0b0/namespaces/openshift-adp/clone.kubevirt.io/virtualmachineclones.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.518012839Z clusters/a6a8f0b0/namespaces/openshift-adp/core/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.518075613Z clusters/a6a8f0b0/namespaces/openshift-adp/core/configmaps.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.518294104Z clusters/a6a8f0b0/namespaces/openshift-adp/core/endpoints.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.518421401Z clusters/a6a8f0b0/namespaces/openshift-adp/core/events.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.521397963Z clusters/a6a8f0b0/namespaces/openshift-adp/core/persistentvolumeclaims.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.52152313Z clusters/a6a8f0b0/namespaces/openshift-adp/core/pods.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.521761993Z clusters/a6a8f0b0/namespaces/openshift-adp/core/replicationcontrollers.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.521931112Z clusters/a6a8f0b0/namespaces/openshift-adp/core/secrets.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.522163135Z clusters/a6a8f0b0/namespaces/openshift-adp/core/services.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.52225981Z clusters/a6a8f0b0/namespaces/openshift-adp/discovery.k8s.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.522318384Z clusters/a6a8f0b0/namespaces/openshift-adp/discovery.k8s.io/endpointslices.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.522396028Z clusters/a6a8f0b0/namespaces/openshift-adp/export.kubevirt.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.522469192Z clusters/a6a8f0b0/namespaces/openshift-adp/export.kubevirt.io/virtualmachineexports.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.522533305Z clusters/a6a8f0b0/namespaces/openshift-adp/hco.kubevirt.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.522598389Z clusters/a6a8f0b0/namespaces/openshift-adp/hco.kubevirt.io/hyperconvergeds.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.522670633Z clusters/a6a8f0b0/namespaces/openshift-adp/image.openshift.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.522731906Z clusters/a6a8f0b0/namespaces/openshift-adp/image.openshift.io/imagestreams.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.52280453Z clusters/a6a8f0b0/namespaces/openshift-adp/instancetype.kubevirt.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.522868514Z clusters/a6a8f0b0/namespaces/openshift-adp/instancetype.kubevirt.io/virtualmachineinstancetypes.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.52299769Z clusters/a6a8f0b0/namespaces/openshift-adp/instancetype.kubevirt.io/virtualmachinepreferences.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.523062494Z clusters/a6a8f0b0/namespaces/openshift-adp/k8s.ovn.org/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.523129388Z clusters/a6a8f0b0/namespaces/openshift-adp/k8s.ovn.org/egressfirewalls.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.523290877Z clusters/a6a8f0b0/namespaces/openshift-adp/k8s.ovn.org/egressqoses.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.523343999Z clusters/a6a8f0b0/namespaces/openshift-adp/kubevirt.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.523421544Z clusters/a6a8f0b0/namespaces/openshift-adp/kubevirt.io/kubevirts.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.52354592Z clusters/a6a8f0b0/namespaces/openshift-adp/kubevirt.io/virtualmachineinstancemigrations.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.523672337Z clusters/a6a8f0b0/namespaces/openshift-adp/kubevirt.io/virtualmachineinstancepresets.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.523798094Z clusters/a6a8f0b0/namespaces/openshift-adp/kubevirt.io/virtualmachineinstancereplicasets.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.523999875Z clusters/a6a8f0b0/namespaces/openshift-adp/kubevirt.io/virtualmachineinstances.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.524127022Z clusters/a6a8f0b0/namespaces/openshift-adp/kubevirt.io/virtualmachines.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.524199206Z clusters/a6a8f0b0/namespaces/openshift-adp/monitoring.coreos.com/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.524308922Z clusters/a6a8f0b0/namespaces/openshift-adp/monitoring.coreos.com/servicemonitors.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.524380396Z clusters/a6a8f0b0/namespaces/openshift-adp/networking.k8s.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.524446609Z clusters/a6a8f0b0/namespaces/openshift-adp/networking.k8s.io/networkpolicies.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.524513503Z clusters/a6a8f0b0/namespaces/openshift-adp/operators.coreos.com/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.524523193Z clusters/a6a8f0b0/namespaces/openshift-adp/operators.coreos.com/clusterserviceversions/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.524592857Z clusters/a6a8f0b0/namespaces/openshift-adp/operators.coreos.com/clusterserviceversions/clusterserviceversions.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.525067823Z clusters/a6a8f0b0/namespaces/openshift-adp/operators.coreos.com/subscriptions/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.525136007Z clusters/a6a8f0b0/namespaces/openshift-adp/operators.coreos.com/subscriptions/subscriptions.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.525235942Z clusters/a6a8f0b0/namespaces/openshift-adp/pods/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.525250653Z clusters/a6a8f0b0/namespaces/openshift-adp/pods/openshift-adp-controller-manager-fd84cfc68-kxzzn/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.525323507Z clusters/a6a8f0b0/namespaces/openshift-adp/pods/openshift-adp-controller-manager-fd84cfc68-kxzzn/openshift-adp-controller-manager-fd84cfc68-kxzzn.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.525458154Z clusters/a6a8f0b0/namespaces/openshift-adp/pods/openshift-adp-controller-manager-fd84cfc68-kxzzn/manager/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.525467715Z clusters/a6a8f0b0/namespaces/openshift-adp/pods/openshift-adp-controller-manager-fd84cfc68-kxzzn/manager/manager/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.525471665Z clusters/a6a8f0b0/namespaces/openshift-adp/pods/openshift-adp-controller-manager-fd84cfc68-kxzzn/manager/manager/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.525549349Z clusters/a6a8f0b0/namespaces/openshift-adp/pods/openshift-adp-controller-manager-fd84cfc68-kxzzn/manager/manager/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.526779176Z clusters/a6a8f0b0/namespaces/openshift-adp/pods/openshift-adp-controller-manager-fd84cfc68-kxzzn/manager/manager/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.526900893Z clusters/a6a8f0b0/namespaces/openshift-adp/pods/openshift-adp-controller-manager-fd84cfc68-kxzzn/manager/manager/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.526962837Z clusters/a6a8f0b0/namespaces/openshift-adp/pods/test-oadp-439-ts-dpa-1-kopia-maintain-job-1770316765827-6gnm2/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.52703464Z clusters/a6a8f0b0/namespaces/openshift-adp/pods/test-oadp-439-ts-dpa-1-kopia-maintain-job-1770316765827-6gnm2/test-oadp-439-ts-dpa-1-kopia-maintain-job-1770316765827-6gnm2.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.527187519Z clusters/a6a8f0b0/namespaces/openshift-adp/pods/test-oadp-439-ts-dpa-1-kopia-maintain-job-1770316765827-6gnm2/velero-repo-maintenance-container/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.52720213Z clusters/a6a8f0b0/namespaces/openshift-adp/pods/test-oadp-439-ts-dpa-1-kopia-maintain-job-1770316765827-6gnm2/velero-repo-maintenance-container/velero-repo-maintenance-container/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.527250462Z clusters/a6a8f0b0/namespaces/openshift-adp/pods/test-oadp-439-ts-dpa-1-kopia-maintain-job-1770316765827-6gnm2/velero-repo-maintenance-container/velero-repo-maintenance-container/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.527326736Z clusters/a6a8f0b0/namespaces/openshift-adp/pods/test-oadp-439-ts-dpa-1-kopia-maintain-job-1770316765827-6gnm2/velero-repo-maintenance-container/velero-repo-maintenance-container/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.527507046Z clusters/a6a8f0b0/namespaces/openshift-adp/pods/test-oadp-439-ts-dpa-1-kopia-maintain-job-1770316765827-6gnm2/velero-repo-maintenance-container/velero-repo-maintenance-container/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.527632713Z clusters/a6a8f0b0/namespaces/openshift-adp/pods/test-oadp-439-ts-dpa-1-kopia-maintain-job-1770316765827-6gnm2/velero-repo-maintenance-container/velero-repo-maintenance-container/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.527687226Z clusters/a6a8f0b0/namespaces/openshift-adp/policy/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.52775707Z clusters/a6a8f0b0/namespaces/openshift-adp/policy/poddisruptionbudgets.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.527831114Z clusters/a6a8f0b0/namespaces/openshift-adp/pool.kubevirt.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.527899267Z clusters/a6a8f0b0/namespaces/openshift-adp/pool.kubevirt.io/virtualmachinepools.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.527971371Z clusters/a6a8f0b0/namespaces/openshift-adp/route.openshift.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.528031255Z clusters/a6a8f0b0/namespaces/openshift-adp/route.openshift.io/routes.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.528107909Z clusters/a6a8f0b0/namespaces/openshift-adp/snapshot.kubevirt.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.528163692Z clusters/a6a8f0b0/namespaces/openshift-adp/snapshot.kubevirt.io/virtualmachinerestores.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.52832257Z clusters/a6a8f0b0/namespaces/openshift-adp/snapshot.kubevirt.io/virtualmachinesnapshotcontents.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.528441247Z clusters/a6a8f0b0/namespaces/openshift-adp/snapshot.kubevirt.io/virtualmachinesnapshots.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.528508561Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.528519231Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/backuprepositories/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.528579744Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/backuprepositories/backuprepositories.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.528666479Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/backups/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.528740793Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/backups/backups.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.528920073Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/backups/describe-django-persistent-48f83df5-02c1-11f1-a139-0a58ac1896e8.txt [must-gather-x9k62] OUT 2026-02-05T18:53:41.52905914Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/backups/describe-empty-project-e2e-3c7cac45-02c2-11f1-a139-0a58ac1896e8.txt [must-gather-x9k62] OUT 2026-02-05T18:53:41.529336876Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/backups/describe-mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8.txt [must-gather-x9k62] OUT 2026-02-05T18:53:41.529483724Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/backups/describe-mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8.txt [must-gather-x9k62] OUT 2026-02-05T18:53:41.529639072Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/backups/describe-mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8.txt [must-gather-x9k62] OUT 2026-02-05T18:53:41.529794661Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/backups/describe-mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8.txt [must-gather-x9k62] OUT 2026-02-05T18:53:41.529921838Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/backups/describe-todolist-backup-1a8737c8-02c3-11f1-a139-0a58ac1896e8.txt [must-gather-x9k62] OUT 2026-02-05T18:53:41.530039634Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/backups/describe-todolist-backup-2ce9b9d5-02c3-11f1-a139-0a58ac1896e8.txt [must-gather-x9k62] OUT 2026-02-05T18:53:41.530095447Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/datadownloads/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.53015728Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/datadownloads/datadownloads.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.530265126Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/datauploads/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.53033238Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/datauploads/datauploads.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.530411794Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/downloadrequests/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.530479618Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/downloadrequests/downloadrequests.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.530618756Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/podvolumebackups/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.530677889Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/podvolumebackups/podvolumebackups.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.530779234Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/podvolumerestores/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.530837567Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/podvolumerestores/podvolumerestores.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.530929702Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/restores/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.530992396Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/restores/describe-django-persistent-48f83df5-02c1-11f1-a139-0a58ac1896e8.txt [must-gather-x9k62] OUT 2026-02-05T18:53:41.531108932Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/restores/describe-empty-project-e2e-3c7cac45-02c2-11f1-a139-0a58ac1896e8.txt [must-gather-x9k62] OUT 2026-02-05T18:53:41.531331114Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/restores/describe-mysql-3b7a5c12-02b9-11f1-a139-0a58ac1896e8.txt [must-gather-x9k62] OUT 2026-02-05T18:53:41.53144841Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/restores/describe-mysql-5eeec208-02c0-11f1-a139-0a58ac1896e8.txt [must-gather-x9k62] OUT 2026-02-05T18:53:41.531572267Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/restores/describe-mysql-d13bc614-02c0-11f1-a139-0a58ac1896e8.txt [must-gather-x9k62] OUT 2026-02-05T18:53:41.531690014Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/restores/describe-mysql-hooks-e2e-70dda019-02c2-11f1-a139-0a58ac1896e8.txt [must-gather-x9k62] OUT 2026-02-05T18:53:41.5318066Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/restores/describe-ocp-datavolume-5d53c5a8-02b2-11f1-a828-0a58ac1896e8.txt [must-gather-x9k62] OUT 2026-02-05T18:53:41.531922176Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/restores/describe-todolist-backup-1a8737c8-02c3-11f1-a139-0a58ac1896e8.txt [must-gather-x9k62] OUT 2026-02-05T18:53:41.532037923Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/restores/describe-todolist-backup-2ce9b9d5-02c3-11f1-a139-0a58ac1896e8.txt [must-gather-x9k62] OUT 2026-02-05T18:53:41.532152429Z clusters/a6a8f0b0/namespaces/openshift-adp/velero.io/restores/restores.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.532275256Z clusters/a6a8f0b0/namespaces/openshift-cnv/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.532328978Z clusters/a6a8f0b0/namespaces/openshift-cnv/openshift-cnv.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.532403553Z clusters/a6a8f0b0/namespaces/openshift-cnv/apps.openshift.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.532458646Z clusters/a6a8f0b0/namespaces/openshift-cnv/apps.openshift.io/deploymentconfigs.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.532515959Z clusters/a6a8f0b0/namespaces/openshift-cnv/apps/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.532568572Z clusters/a6a8f0b0/namespaces/openshift-cnv/apps/daemonsets.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.532763212Z clusters/a6a8f0b0/namespaces/openshift-cnv/apps/deployments.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.533794178Z clusters/a6a8f0b0/namespaces/openshift-cnv/apps/replicasets.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.534568671Z clusters/a6a8f0b0/namespaces/openshift-cnv/apps/statefulsets.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.534618213Z clusters/a6a8f0b0/namespaces/openshift-cnv/autoscaling/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.534672156Z clusters/a6a8f0b0/namespaces/openshift-cnv/autoscaling/horizontalpodautoscalers.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.53473224Z clusters/a6a8f0b0/namespaces/openshift-cnv/batch/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.534786612Z clusters/a6a8f0b0/namespaces/openshift-cnv/batch/cronjobs.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.534900409Z clusters/a6a8f0b0/namespaces/openshift-cnv/batch/jobs.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.534955842Z clusters/a6a8f0b0/namespaces/openshift-cnv/build.openshift.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.535010255Z clusters/a6a8f0b0/namespaces/openshift-cnv/build.openshift.io/buildconfigs.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.535124021Z clusters/a6a8f0b0/namespaces/openshift-cnv/build.openshift.io/builds.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.535170913Z clusters/a6a8f0b0/namespaces/openshift-cnv/cdi.kubevirt.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.535267138Z clusters/a6a8f0b0/namespaces/openshift-cnv/cdi.kubevirt.io/dataimportcrons.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.535369204Z clusters/a6a8f0b0/namespaces/openshift-cnv/cdi.kubevirt.io/datasources.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.535468029Z clusters/a6a8f0b0/namespaces/openshift-cnv/cdi.kubevirt.io/datavolumes.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.535517082Z clusters/a6a8f0b0/namespaces/openshift-cnv/clone.kubevirt.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.535582326Z clusters/a6a8f0b0/namespaces/openshift-cnv/clone.kubevirt.io/virtualmachineclones.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.535634599Z clusters/a6a8f0b0/namespaces/openshift-cnv/core/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.535699422Z clusters/a6a8f0b0/namespaces/openshift-cnv/core/configmaps.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.537625607Z clusters/a6a8f0b0/namespaces/openshift-cnv/core/endpoints.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.537825308Z clusters/a6a8f0b0/namespaces/openshift-cnv/core/events.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.539357041Z clusters/a6a8f0b0/namespaces/openshift-cnv/core/persistentvolumeclaims.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.539442396Z clusters/a6a8f0b0/namespaces/openshift-cnv/core/pods.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.540978849Z clusters/a6a8f0b0/namespaces/openshift-cnv/core/replicationcontrollers.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.541130588Z clusters/a6a8f0b0/namespaces/openshift-cnv/core/secrets.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.5417275Z clusters/a6a8f0b0/namespaces/openshift-cnv/core/services.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.541890259Z clusters/a6a8f0b0/namespaces/openshift-cnv/discovery.k8s.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.541951173Z clusters/a6a8f0b0/namespaces/openshift-cnv/discovery.k8s.io/endpointslices.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.542187455Z clusters/a6a8f0b0/namespaces/openshift-cnv/export.kubevirt.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.54226261Z clusters/a6a8f0b0/namespaces/openshift-cnv/export.kubevirt.io/virtualmachineexports.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.542328393Z clusters/a6a8f0b0/namespaces/openshift-cnv/hco.kubevirt.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.542380326Z clusters/a6a8f0b0/namespaces/openshift-cnv/hco.kubevirt.io/hyperconvergeds.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.542488562Z clusters/a6a8f0b0/namespaces/openshift-cnv/image.openshift.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.542544875Z clusters/a6a8f0b0/namespaces/openshift-cnv/image.openshift.io/imagestreams.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.542600168Z clusters/a6a8f0b0/namespaces/openshift-cnv/instancetype.kubevirt.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.542655291Z clusters/a6a8f0b0/namespaces/openshift-cnv/instancetype.kubevirt.io/virtualmachineinstancetypes.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.542766827Z clusters/a6a8f0b0/namespaces/openshift-cnv/instancetype.kubevirt.io/virtualmachinepreferences.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.54282152Z clusters/a6a8f0b0/namespaces/openshift-cnv/k8s.ovn.org/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.542881183Z clusters/a6a8f0b0/namespaces/openshift-cnv/k8s.ovn.org/egressfirewalls.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.542986989Z clusters/a6a8f0b0/namespaces/openshift-cnv/k8s.ovn.org/egressqoses.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.543042342Z clusters/a6a8f0b0/namespaces/openshift-cnv/kubevirt.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.543114076Z clusters/a6a8f0b0/namespaces/openshift-cnv/kubevirt.io/kubevirts.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.543324387Z clusters/a6a8f0b0/namespaces/openshift-cnv/kubevirt.io/virtualmachineinstancemigrations.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.543433543Z clusters/a6a8f0b0/namespaces/openshift-cnv/kubevirt.io/virtualmachineinstancepresets.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.543536889Z clusters/a6a8f0b0/namespaces/openshift-cnv/kubevirt.io/virtualmachineinstancereplicasets.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.543709288Z clusters/a6a8f0b0/namespaces/openshift-cnv/kubevirt.io/virtualmachineinstances.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.543827905Z clusters/a6a8f0b0/namespaces/openshift-cnv/kubevirt.io/virtualmachines.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.543874827Z clusters/a6a8f0b0/namespaces/openshift-cnv/monitoring.coreos.com/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.543943701Z clusters/a6a8f0b0/namespaces/openshift-cnv/monitoring.coreos.com/servicemonitors.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.544026846Z clusters/a6a8f0b0/namespaces/openshift-cnv/networking.k8s.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.544082329Z clusters/a6a8f0b0/namespaces/openshift-cnv/networking.k8s.io/networkpolicies.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.544177704Z clusters/a6a8f0b0/namespaces/openshift-cnv/operators.coreos.com/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.544185724Z clusters/a6a8f0b0/namespaces/openshift-cnv/operators.coreos.com/clusterserviceversions/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.544268429Z clusters/a6a8f0b0/namespaces/openshift-cnv/operators.coreos.com/clusterserviceversions/clusterserviceversions.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.544970267Z clusters/a6a8f0b0/namespaces/openshift-cnv/operators.coreos.com/subscriptions/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.54502717Z clusters/a6a8f0b0/namespaces/openshift-cnv/operators.coreos.com/subscriptions/subscriptions.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.545105364Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.545113205Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/aaq-operator-76b56887f5-nkm6l/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.545170458Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/aaq-operator-76b56887f5-nkm6l/aaq-operator-76b56887f5-nkm6l.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.545303275Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/aaq-operator-76b56887f5-nkm6l/aaq-operator/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.545316826Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/aaq-operator-76b56887f5-nkm6l/aaq-operator/aaq-operator/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.545326716Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/aaq-operator-76b56887f5-nkm6l/aaq-operator/aaq-operator/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.54538605Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/aaq-operator-76b56887f5-nkm6l/aaq-operator/aaq-operator/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.545524687Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/aaq-operator-76b56887f5-nkm6l/aaq-operator/aaq-operator/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.545628753Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/aaq-operator-76b56887f5-nkm6l/aaq-operator/aaq-operator/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.545675205Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/bridge-marker-56tll/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.545738079Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/bridge-marker-56tll/bridge-marker-56tll.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.545807403Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/bridge-marker-56tll/bridge-marker/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.545815493Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/bridge-marker-56tll/bridge-marker/bridge-marker/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.545819623Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/bridge-marker-56tll/bridge-marker/bridge-marker/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.545891387Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/bridge-marker-56tll/bridge-marker/bridge-marker/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.545993363Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/bridge-marker-56tll/bridge-marker/bridge-marker/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.546100959Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/bridge-marker-56tll/bridge-marker/bridge-marker/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.546141761Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/bridge-marker-gjfzp/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.546233146Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/bridge-marker-gjfzp/bridge-marker-gjfzp.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.546350562Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/bridge-marker-gjfzp/bridge-marker/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.546359323Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/bridge-marker-gjfzp/bridge-marker/bridge-marker/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.546363323Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/bridge-marker-gjfzp/bridge-marker/bridge-marker/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.546430657Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/bridge-marker-gjfzp/bridge-marker/bridge-marker/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.546540423Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/bridge-marker-gjfzp/bridge-marker/bridge-marker/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.546646788Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/bridge-marker-gjfzp/bridge-marker/bridge-marker/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.546685811Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/bridge-marker-rmpf7/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.546746204Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/bridge-marker-rmpf7/bridge-marker-rmpf7.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.546827918Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/bridge-marker-rmpf7/bridge-marker/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.546837529Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/bridge-marker-rmpf7/bridge-marker/bridge-marker/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.546842429Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/bridge-marker-rmpf7/bridge-marker/bridge-marker/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.546898182Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/bridge-marker-rmpf7/bridge-marker/bridge-marker/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.547001328Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/bridge-marker-rmpf7/bridge-marker/bridge-marker/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.547105413Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/bridge-marker-rmpf7/bridge-marker/bridge-marker/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.547150606Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-apiserver-7c7bf4df96-txzdw/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.54723184Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-apiserver-7c7bf4df96-txzdw/cdi-apiserver-7c7bf4df96-txzdw.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.547333296Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-apiserver-7c7bf4df96-txzdw/cdi-apiserver/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.547342296Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-apiserver-7c7bf4df96-txzdw/cdi-apiserver/cdi-apiserver/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.547346546Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-apiserver-7c7bf4df96-txzdw/cdi-apiserver/cdi-apiserver/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.54741074Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-apiserver-7c7bf4df96-txzdw/cdi-apiserver/cdi-apiserver/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.547575659Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-apiserver-7c7bf4df96-txzdw/cdi-apiserver/cdi-apiserver/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.547733977Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-apiserver-7c7bf4df96-txzdw/cdi-apiserver/cdi-apiserver/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.547806592Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-deployment-7f6d468bc9-tk5m2/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.547887166Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-deployment-7f6d468bc9-tk5m2/cdi-deployment-7f6d468bc9-tk5m2.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.547983511Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-deployment-7f6d468bc9-tk5m2/cdi-deployment/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.547992182Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-deployment-7f6d468bc9-tk5m2/cdi-deployment/cdi-deployment/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.547996372Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-deployment-7f6d468bc9-tk5m2/cdi-deployment/cdi-deployment/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.548062035Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-deployment-7f6d468bc9-tk5m2/cdi-deployment/cdi-deployment/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.56964243Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-deployment-7f6d468bc9-tk5m2/cdi-deployment/cdi-deployment/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.569757097Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-deployment-7f6d468bc9-tk5m2/cdi-deployment/cdi-deployment/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.569783838Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-operator-6b95b6bd7f-qnwgd/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.569855622Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-operator-6b95b6bd7f-qnwgd/cdi-operator-6b95b6bd7f-qnwgd.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.569970878Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-operator-6b95b6bd7f-qnwgd/cdi-operator/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.569978849Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-operator-6b95b6bd7f-qnwgd/cdi-operator/cdi-operator/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.569983139Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-operator-6b95b6bd7f-qnwgd/cdi-operator/cdi-operator/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.570048723Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-operator-6b95b6bd7f-qnwgd/cdi-operator/cdi-operator/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.571246508Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-operator-6b95b6bd7f-qnwgd/cdi-operator/cdi-operator/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.571370704Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-operator-6b95b6bd7f-qnwgd/cdi-operator/cdi-operator/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.571405557Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-uploadproxy-6856464f6b-nt47j/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.571486181Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-uploadproxy-6856464f6b-nt47j/cdi-uploadproxy-6856464f6b-nt47j.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.571587306Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-uploadproxy-6856464f6b-nt47j/cdi-uploadproxy/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.571598817Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-uploadproxy-6856464f6b-nt47j/cdi-uploadproxy/cdi-uploadproxy/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.571603117Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-uploadproxy-6856464f6b-nt47j/cdi-uploadproxy/cdi-uploadproxy/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.571685792Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-uploadproxy-6856464f6b-nt47j/cdi-uploadproxy/cdi-uploadproxy/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.571820659Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-uploadproxy-6856464f6b-nt47j/cdi-uploadproxy/cdi-uploadproxy/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.571945836Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cdi-uploadproxy-6856464f6b-nt47j/cdi-uploadproxy/cdi-uploadproxy/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.571998699Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cluster-network-addons-operator-658667f846-r6n7q/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.572079663Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cluster-network-addons-operator-658667f846-r6n7q/cluster-network-addons-operator-658667f846-r6n7q.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.572285974Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cluster-network-addons-operator-658667f846-r6n7q/cluster-network-addons-operator/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.572304446Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cluster-network-addons-operator-658667f846-r6n7q/cluster-network-addons-operator/cluster-network-addons-operator/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.572312396Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cluster-network-addons-operator-658667f846-r6n7q/cluster-network-addons-operator/cluster-network-addons-operator/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.57239602Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cluster-network-addons-operator-658667f846-r6n7q/cluster-network-addons-operator/cluster-network-addons-operator/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.577654347Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cluster-network-addons-operator-658667f846-r6n7q/cluster-network-addons-operator/cluster-network-addons-operator/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.577777433Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cluster-network-addons-operator-658667f846-r6n7q/cluster-network-addons-operator/cluster-network-addons-operator/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.577796454Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cluster-network-addons-operator-658667f846-r6n7q/kube-rbac-proxy/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.577804805Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cluster-network-addons-operator-658667f846-r6n7q/kube-rbac-proxy/kube-rbac-proxy/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.577812065Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cluster-network-addons-operator-658667f846-r6n7q/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.577924592Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cluster-network-addons-operator-658667f846-r6n7q/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.578060379Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cluster-network-addons-operator-658667f846-r6n7q/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.578184826Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/cluster-network-addons-operator-658667f846-r6n7q/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.578254099Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hco-operator-749c6bb784-8zjtb/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.578332814Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hco-operator-749c6bb784-8zjtb/hco-operator-749c6bb784-8zjtb.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.57845711Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hco-operator-749c6bb784-8zjtb/hyperconverged-cluster-operator/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.578464601Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hco-operator-749c6bb784-8zjtb/hyperconverged-cluster-operator/hyperconverged-cluster-operator/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.578468721Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hco-operator-749c6bb784-8zjtb/hyperconverged-cluster-operator/hyperconverged-cluster-operator/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.578571607Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hco-operator-749c6bb784-8zjtb/hyperconverged-cluster-operator/hyperconverged-cluster-operator/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.597318388Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hco-operator-749c6bb784-8zjtb/hyperconverged-cluster-operator/hyperconverged-cluster-operator/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.597445904Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hco-operator-749c6bb784-8zjtb/hyperconverged-cluster-operator/hyperconverged-cluster-operator/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.597499318Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hco-webhook-6fc4b7cdc8-6wpvr/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.597586302Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hco-webhook-6fc4b7cdc8-6wpvr/hco-webhook-6fc4b7cdc8-6wpvr.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.597740271Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hco-webhook-6fc4b7cdc8-6wpvr/hyperconverged-cluster-webhook/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.597751191Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hco-webhook-6fc4b7cdc8-6wpvr/hyperconverged-cluster-webhook/hyperconverged-cluster-webhook/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.597756272Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hco-webhook-6fc4b7cdc8-6wpvr/hyperconverged-cluster-webhook/hyperconverged-cluster-webhook/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.597825365Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hco-webhook-6fc4b7cdc8-6wpvr/hyperconverged-cluster-webhook/hyperconverged-cluster-webhook/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.598334173Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hco-webhook-6fc4b7cdc8-6wpvr/hyperconverged-cluster-webhook/hyperconverged-cluster-webhook/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.598450829Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hco-webhook-6fc4b7cdc8-6wpvr/hyperconverged-cluster-webhook/hyperconverged-cluster-webhook/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.598503542Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hostpath-provisioner-operator-776bb59d65-qc6jg/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.598579706Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hostpath-provisioner-operator-776bb59d65-qc6jg/hostpath-provisioner-operator-776bb59d65-qc6jg.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.598708553Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hostpath-provisioner-operator-776bb59d65-qc6jg/hostpath-provisioner-operator/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.598717654Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hostpath-provisioner-operator-776bb59d65-qc6jg/hostpath-provisioner-operator/hostpath-provisioner-operator/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.598727694Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hostpath-provisioner-operator-776bb59d65-qc6jg/hostpath-provisioner-operator/hostpath-provisioner-operator/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.598808929Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hostpath-provisioner-operator-776bb59d65-qc6jg/hostpath-provisioner-operator/hostpath-provisioner-operator/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.598950846Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hostpath-provisioner-operator-776bb59d65-qc6jg/hostpath-provisioner-operator/hostpath-provisioner-operator/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.599061143Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hostpath-provisioner-operator-776bb59d65-qc6jg/hostpath-provisioner-operator/hostpath-provisioner-operator/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.599095744Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hyperconverged-cluster-cli-download-7d748cbbbd-jqzvt/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.599165308Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hyperconverged-cluster-cli-download-7d748cbbbd-jqzvt/hyperconverged-cluster-cli-download-7d748cbbbd-jqzvt.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.599301025Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hyperconverged-cluster-cli-download-7d748cbbbd-jqzvt/server/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.599316286Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hyperconverged-cluster-cli-download-7d748cbbbd-jqzvt/server/server/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.599320637Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hyperconverged-cluster-cli-download-7d748cbbbd-jqzvt/server/server/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.59938165Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hyperconverged-cluster-cli-download-7d748cbbbd-jqzvt/server/server/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.599541569Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hyperconverged-cluster-cli-download-7d748cbbbd-jqzvt/server/server/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.599666435Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/hyperconverged-cluster-cli-download-7d748cbbbd-jqzvt/server/server/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.599712698Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kube-cni-linux-bridge-plugin-4gvhj/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.599806683Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kube-cni-linux-bridge-plugin-4gvhj/kube-cni-linux-bridge-plugin-4gvhj.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.599904078Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kube-cni-linux-bridge-plugin-4gvhj/cni-plugins/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.599917089Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kube-cni-linux-bridge-plugin-4gvhj/cni-plugins/cni-plugins/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.599923829Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kube-cni-linux-bridge-plugin-4gvhj/cni-plugins/cni-plugins/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.600000623Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kube-cni-linux-bridge-plugin-4gvhj/cni-plugins/cni-plugins/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.600148022Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kube-cni-linux-bridge-plugin-4gvhj/cni-plugins/cni-plugins/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.600290779Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kube-cni-linux-bridge-plugin-4gvhj/cni-plugins/cni-plugins/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.600338632Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kube-cni-linux-bridge-plugin-dl4qj/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.600436267Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kube-cni-linux-bridge-plugin-dl4qj/kube-cni-linux-bridge-plugin-dl4qj.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.600521292Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kube-cni-linux-bridge-plugin-dl4qj/cni-plugins/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.600532423Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kube-cni-linux-bridge-plugin-dl4qj/cni-plugins/cni-plugins/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.600536863Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kube-cni-linux-bridge-plugin-dl4qj/cni-plugins/cni-plugins/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.600623688Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kube-cni-linux-bridge-plugin-dl4qj/cni-plugins/cni-plugins/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.600752024Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kube-cni-linux-bridge-plugin-dl4qj/cni-plugins/cni-plugins/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.600875061Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kube-cni-linux-bridge-plugin-dl4qj/cni-plugins/cni-plugins/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.600928954Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kube-cni-linux-bridge-plugin-fv4kt/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.601006849Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kube-cni-linux-bridge-plugin-fv4kt/kube-cni-linux-bridge-plugin-fv4kt.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.601113514Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kube-cni-linux-bridge-plugin-fv4kt/cni-plugins/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.601121085Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kube-cni-linux-bridge-plugin-fv4kt/cni-plugins/cni-plugins/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.601125065Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kube-cni-linux-bridge-plugin-fv4kt/cni-plugins/cni-plugins/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.601238451Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kube-cni-linux-bridge-plugin-fv4kt/cni-plugins/cni-plugins/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.601369248Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kube-cni-linux-bridge-plugin-fv4kt/cni-plugins/cni-plugins/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.601491265Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kube-cni-linux-bridge-plugin-fv4kt/cni-plugins/cni-plugins/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.601545768Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubemacpool-cert-manager-677779b56-sv9wx/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.601624162Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubemacpool-cert-manager-677779b56-sv9wx/kubemacpool-cert-manager-677779b56-sv9wx.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.601723928Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubemacpool-cert-manager-677779b56-sv9wx/manager/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.601731608Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubemacpool-cert-manager-677779b56-sv9wx/manager/manager/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.601735578Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubemacpool-cert-manager-677779b56-sv9wx/manager/manager/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.601811522Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubemacpool-cert-manager-677779b56-sv9wx/manager/manager/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.602084937Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubemacpool-cert-manager-677779b56-sv9wx/manager/manager/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.602200683Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubemacpool-cert-manager-677779b56-sv9wx/manager/manager/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.602288278Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubemacpool-mac-controller-manager-6468947cf5-b6wt2/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.602361752Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubemacpool-mac-controller-manager-6468947cf5-b6wt2/kubemacpool-mac-controller-manager-6468947cf5-b6wt2.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.602483489Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubemacpool-mac-controller-manager-6468947cf5-b6wt2/kube-rbac-proxy/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.602495759Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubemacpool-mac-controller-manager-6468947cf5-b6wt2/kube-rbac-proxy/kube-rbac-proxy/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.60249996Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubemacpool-mac-controller-manager-6468947cf5-b6wt2/kube-rbac-proxy/kube-rbac-proxy/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.602569054Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubemacpool-mac-controller-manager-6468947cf5-b6wt2/kube-rbac-proxy/kube-rbac-proxy/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.602716982Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubemacpool-mac-controller-manager-6468947cf5-b6wt2/kube-rbac-proxy/kube-rbac-proxy/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.602835548Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubemacpool-mac-controller-manager-6468947cf5-b6wt2/kube-rbac-proxy/kube-rbac-proxy/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.602888621Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubemacpool-mac-controller-manager-6468947cf5-b6wt2/manager/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.602898972Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubemacpool-mac-controller-manager-6468947cf5-b6wt2/manager/manager/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.602906922Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubemacpool-mac-controller-manager-6468947cf5-b6wt2/manager/manager/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.602986086Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubemacpool-mac-controller-manager-6468947cf5-b6wt2/manager/manager/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.603504094Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubemacpool-mac-controller-manager-6468947cf5-b6wt2/manager/manager/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.603599179Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-apiserver-proxy-5c5fc795c5-5b785/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.603675784Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-apiserver-proxy-5c5fc795c5-5b785/kubevirt-apiserver-proxy-5c5fc795c5-5b785.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.603764999Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-apiserver-proxy-5c5fc795c5-5b785/kubevirt-apiserver-proxy/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.603773519Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-apiserver-proxy-5c5fc795c5-5b785/kubevirt-apiserver-proxy/kubevirt-apiserver-proxy/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.603777709Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-apiserver-proxy-5c5fc795c5-5b785/kubevirt-apiserver-proxy/kubevirt-apiserver-proxy/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.603860654Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-apiserver-proxy-5c5fc795c5-5b785/kubevirt-apiserver-proxy/kubevirt-apiserver-proxy/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.603994781Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-apiserver-proxy-5c5fc795c5-5b785/kubevirt-apiserver-proxy/kubevirt-apiserver-proxy/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.604115028Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-apiserver-proxy-5c5fc795c5-5b785/kubevirt-apiserver-proxy/kubevirt-apiserver-proxy/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.604170361Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-apiserver-proxy-5c5fc795c5-t66xr/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.604293548Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-apiserver-proxy-5c5fc795c5-t66xr/kubevirt-apiserver-proxy-5c5fc795c5-t66xr.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.604383812Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-apiserver-proxy-5c5fc795c5-t66xr/kubevirt-apiserver-proxy/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.604399543Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-apiserver-proxy-5c5fc795c5-t66xr/kubevirt-apiserver-proxy/kubevirt-apiserver-proxy/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.604403853Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-apiserver-proxy-5c5fc795c5-t66xr/kubevirt-apiserver-proxy/kubevirt-apiserver-proxy/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.604489148Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-apiserver-proxy-5c5fc795c5-t66xr/kubevirt-apiserver-proxy/kubevirt-apiserver-proxy/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.604623625Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-apiserver-proxy-5c5fc795c5-t66xr/kubevirt-apiserver-proxy/kubevirt-apiserver-proxy/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.604746762Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-apiserver-proxy-5c5fc795c5-t66xr/kubevirt-apiserver-proxy/kubevirt-apiserver-proxy/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.604799525Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-console-plugin-78d96d6dd4-bgd9g/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.60489675Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-console-plugin-78d96d6dd4-bgd9g/kubevirt-console-plugin-78d96d6dd4-bgd9g.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.604982915Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-console-plugin-78d96d6dd4-bgd9g/kubevirt-console-plugin/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.604992175Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-console-plugin-78d96d6dd4-bgd9g/kubevirt-console-plugin/kubevirt-console-plugin/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.604996516Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-console-plugin-78d96d6dd4-bgd9g/kubevirt-console-plugin/kubevirt-console-plugin/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.60508512Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-console-plugin-78d96d6dd4-bgd9g/kubevirt-console-plugin/kubevirt-console-plugin/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.605225478Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-console-plugin-78d96d6dd4-bgd9g/kubevirt-console-plugin/kubevirt-console-plugin/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.605408018Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-console-plugin-78d96d6dd4-bgd9g/kubevirt-console-plugin/kubevirt-console-plugin/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.605460831Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-console-plugin-78d96d6dd4-lxpdw/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.605545465Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-console-plugin-78d96d6dd4-lxpdw/kubevirt-console-plugin-78d96d6dd4-lxpdw.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.60563518Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-console-plugin-78d96d6dd4-lxpdw/kubevirt-console-plugin/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.605651921Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-console-plugin-78d96d6dd4-lxpdw/kubevirt-console-plugin/kubevirt-console-plugin/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.605658492Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-console-plugin-78d96d6dd4-lxpdw/kubevirt-console-plugin/kubevirt-console-plugin/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.605747796Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-console-plugin-78d96d6dd4-lxpdw/kubevirt-console-plugin/kubevirt-console-plugin/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.605889224Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-console-plugin-78d96d6dd4-lxpdw/kubevirt-console-plugin/kubevirt-console-plugin/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.606015011Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-console-plugin-78d96d6dd4-lxpdw/kubevirt-console-plugin/kubevirt-console-plugin/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.606086835Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-ipam-controller-manager-566c85498f-h9vlh/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.60616847Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-ipam-controller-manager-566c85498f-h9vlh/kubevirt-ipam-controller-manager-566c85498f-h9vlh.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.606312327Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-ipam-controller-manager-566c85498f-h9vlh/manager/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.606328668Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-ipam-controller-manager-566c85498f-h9vlh/manager/manager/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.606335068Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-ipam-controller-manager-566c85498f-h9vlh/manager/manager/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.606416173Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-ipam-controller-manager-566c85498f-h9vlh/manager/manager/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.606614354Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-ipam-controller-manager-566c85498f-h9vlh/manager/manager/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.606782243Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-ipam-controller-manager-566c85498f-h9vlh/manager/manager/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.606845876Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-ipam-controller-manager-566c85498f-qhtlz/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.606977654Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-ipam-controller-manager-566c85498f-qhtlz/kubevirt-ipam-controller-manager-566c85498f-qhtlz.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.60708852Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-ipam-controller-manager-566c85498f-qhtlz/manager/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.60709874Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-ipam-controller-manager-566c85498f-qhtlz/manager/manager/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.60710281Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-ipam-controller-manager-566c85498f-qhtlz/manager/manager/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.607184275Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-ipam-controller-manager-566c85498f-qhtlz/manager/manager/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.607389706Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-ipam-controller-manager-566c85498f-qhtlz/manager/manager/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.607508932Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/kubevirt-ipam-controller-manager-566c85498f-qhtlz/manager/manager/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.607573856Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/ssp-operator-5dfc6855bf-hg28k/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.607635279Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/ssp-operator-5dfc6855bf-hg28k/ssp-operator-5dfc6855bf-hg28k.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.607755316Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/ssp-operator-5dfc6855bf-hg28k/manager/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.607764506Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/ssp-operator-5dfc6855bf-hg28k/manager/manager/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.607769357Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/ssp-operator-5dfc6855bf-hg28k/manager/manager/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.607846121Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/ssp-operator-5dfc6855bf-hg28k/manager/manager/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.610270253Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/ssp-operator-5dfc6855bf-hg28k/manager/manager/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.61040894Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-api-5d697454c5-85h46/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.610482064Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-api-5d697454c5-85h46/virt-api-5d697454c5-85h46.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.610597761Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-api-5d697454c5-85h46/virt-api/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.610610841Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-api-5d697454c5-85h46/virt-api/virt-api/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.610616242Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-api-5d697454c5-85h46/virt-api/virt-api/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.610706006Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-api-5d697454c5-85h46/virt-api/virt-api/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.617702267Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-api-5d697454c5-85h46/virt-api/virt-api/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.617829845Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-api-5d697454c5-85h46/virt-api/virt-api/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.617894838Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-api-5d697454c5-kd4v2/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.617983243Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-api-5d697454c5-kd4v2/virt-api-5d697454c5-kd4v2.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.61810674Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-api-5d697454c5-kd4v2/virt-api/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.61812238Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-api-5d697454c5-kd4v2/virt-api/virt-api/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.618130541Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-api-5d697454c5-kd4v2/virt-api/virt-api/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.618189874Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-api-5d697454c5-kd4v2/virt-api/virt-api/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.624780003Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-api-5d697454c5-kd4v2/virt-api/virt-api/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.62491062Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-api-5d697454c5-kd4v2/virt-api/virt-api/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.624931551Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-controller-64dcd467b4-8k6dp/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.625008605Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-controller-64dcd467b4-8k6dp/virt-controller-64dcd467b4-8k6dp.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.625111961Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-controller-64dcd467b4-8k6dp/virt-controller/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.625121922Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-controller-64dcd467b4-8k6dp/virt-controller/virt-controller/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.625129472Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-controller-64dcd467b4-8k6dp/virt-controller/virt-controller/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.625189755Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-controller-64dcd467b4-8k6dp/virt-controller/virt-controller/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.625800268Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-controller-64dcd467b4-8k6dp/virt-controller/virt-controller/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.625904754Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-controller-64dcd467b4-8k6dp/virt-controller/virt-controller/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.625947047Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-controller-64dcd467b4-f9qq2/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.62601586Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-controller-64dcd467b4-f9qq2/virt-controller-64dcd467b4-f9qq2.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.626098525Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-controller-64dcd467b4-f9qq2/virt-controller/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.626119396Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-controller-64dcd467b4-f9qq2/virt-controller/virt-controller/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.626124146Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-controller-64dcd467b4-f9qq2/virt-controller/virt-controller/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.626184069Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-controller-64dcd467b4-f9qq2/virt-controller/virt-controller/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.626352878Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-controller-64dcd467b4-f9qq2/virt-controller/virt-controller/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.626455204Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-controller-64dcd467b4-f9qq2/virt-controller/virt-controller/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.626501357Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-exportproxy-6b85c76b89-78n7j/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.6265651Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-exportproxy-6b85c76b89-78n7j/virt-exportproxy-6b85c76b89-78n7j.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.626654185Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-exportproxy-6b85c76b89-78n7j/exportproxy/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.626667896Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-exportproxy-6b85c76b89-78n7j/exportproxy/exportproxy/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.626672886Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-exportproxy-6b85c76b89-78n7j/exportproxy/exportproxy/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.626734969Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-exportproxy-6b85c76b89-78n7j/exportproxy/exportproxy/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.626875047Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-exportproxy-6b85c76b89-78n7j/exportproxy/exportproxy/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.626978453Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-exportproxy-6b85c76b89-78n7j/exportproxy/exportproxy/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.627018575Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-exportproxy-6b85c76b89-85z8t/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.627085349Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-exportproxy-6b85c76b89-85z8t/virt-exportproxy-6b85c76b89-85z8t.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.627167603Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-exportproxy-6b85c76b89-85z8t/exportproxy/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.627176133Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-exportproxy-6b85c76b89-85z8t/exportproxy/exportproxy/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.627180114Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-exportproxy-6b85c76b89-85z8t/exportproxy/exportproxy/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.627278969Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-exportproxy-6b85c76b89-85z8t/exportproxy/exportproxy/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.627409296Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-exportproxy-6b85c76b89-85z8t/exportproxy/exportproxy/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.627515132Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-exportproxy-6b85c76b89-85z8t/exportproxy/exportproxy/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.627554914Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-g5gsk/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.627618858Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-g5gsk/virt-handler-g5gsk.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.627721913Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-g5gsk/virt-handler/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.627734484Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-g5gsk/virt-handler/virt-handler/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.627738564Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-g5gsk/virt-handler/virt-handler/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.627801317Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-g5gsk/virt-handler/virt-handler/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.628780551Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-g5gsk/virt-handler/virt-handler/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.628889157Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-g5gsk/virt-handler/virt-handler/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.628905808Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-g5gsk/virt-launcher/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.628919978Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-g5gsk/virt-launcher/virt-launcher/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.628928309Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-g5gsk/virt-launcher/virt-launcher/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.629028124Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-g5gsk/virt-launcher/virt-launcher/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.629189283Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-g5gsk/virt-launcher/virt-launcher/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.629346512Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-g5gsk/virt-launcher/virt-launcher/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.629392004Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-qv8lq/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.629494089Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-qv8lq/virt-handler-qv8lq.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.629606636Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-qv8lq/virt-handler/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.629633777Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-qv8lq/virt-handler/virt-handler/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.629638777Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-qv8lq/virt-handler/virt-handler/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.629707321Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-qv8lq/virt-handler/virt-handler/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.6300565Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-qv8lq/virt-handler/virt-handler/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.630172086Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-qv8lq/virt-handler/virt-handler/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.630249321Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-qv8lq/virt-launcher/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.630261231Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-qv8lq/virt-launcher/virt-launcher/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.630266642Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-qv8lq/virt-launcher/virt-launcher/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.630349796Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-qv8lq/virt-launcher/virt-launcher/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.630475773Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-qv8lq/virt-launcher/virt-launcher/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.630582429Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-qv8lq/virt-launcher/virt-launcher/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.630625051Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-sm52r/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.630697535Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-sm52r/virt-handler-sm52r.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.630806091Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-sm52r/virt-handler/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.630817192Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-sm52r/virt-handler/virt-handler/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.630825052Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-sm52r/virt-handler/virt-handler/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.630915517Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-sm52r/virt-handler/virt-handler/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.631288807Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-sm52r/virt-handler/virt-handler/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.631416844Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-sm52r/virt-handler/virt-handler/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.631470987Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-sm52r/virt-launcher/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.631478838Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-sm52r/virt-launcher/virt-launcher/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.631483738Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-sm52r/virt-launcher/virt-launcher/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.631559682Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-sm52r/virt-launcher/virt-launcher/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.63170783Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-sm52r/virt-launcher/virt-launcher/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.631824387Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-handler-sm52r/virt-launcher/virt-launcher/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.631861958Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-operator-6d67dd8845-n9659/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.631955694Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-operator-6d67dd8845-n9659/virt-operator-6d67dd8845-n9659.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.632086531Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-operator-6d67dd8845-n9659/virt-operator/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.632095511Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-operator-6d67dd8845-n9659/virt-operator/virt-operator/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.632099491Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-operator-6d67dd8845-n9659/virt-operator/virt-operator/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.632197837Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-operator-6d67dd8845-n9659/virt-operator/virt-operator/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.645587426Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-operator-6d67dd8845-n9659/virt-operator/virt-operator/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.645713963Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-operator-6d67dd8845-n9659/virt-operator/virt-operator/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.645776546Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-operator-6d67dd8845-tm5jz/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.645857521Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-operator-6d67dd8845-tm5jz/virt-operator-6d67dd8845-tm5jz.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.64602857Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-operator-6d67dd8845-tm5jz/virt-operator/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.646040051Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-operator-6d67dd8845-tm5jz/virt-operator/virt-operator/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.646045151Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-operator-6d67dd8845-tm5jz/virt-operator/virt-operator/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.646108554Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-operator-6d67dd8845-tm5jz/virt-operator/virt-operator/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.646329046Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-operator-6d67dd8845-tm5jz/virt-operator/virt-operator/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.646455273Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-operator-6d67dd8845-tm5jz/virt-operator/virt-operator/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.646507386Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-template-validator-5f84757967-fhjnc/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.64657944Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-template-validator-5f84757967-fhjnc/virt-template-validator-5f84757967-fhjnc.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.646678796Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-template-validator-5f84757967-fhjnc/webhook/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.646687896Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-template-validator-5f84757967-fhjnc/webhook/webhook/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.646691946Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-template-validator-5f84757967-fhjnc/webhook/webhook/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.646773421Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-template-validator-5f84757967-fhjnc/webhook/webhook/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.646909408Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-template-validator-5f84757967-fhjnc/webhook/webhook/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.647028524Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-template-validator-5f84757967-fhjnc/webhook/webhook/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.647081947Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-template-validator-5f84757967-hmwxg/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.647157551Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-template-validator-5f84757967-hmwxg/virt-template-validator-5f84757967-hmwxg.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.647281098Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-template-validator-5f84757967-hmwxg/webhook/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.647292109Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-template-validator-5f84757967-hmwxg/webhook/webhook/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.647296059Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-template-validator-5f84757967-hmwxg/webhook/webhook/logs/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.647378363Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-template-validator-5f84757967-hmwxg/webhook/webhook/logs/current.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.647527472Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-template-validator-5f84757967-hmwxg/webhook/webhook/logs/previous.insecure.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.647650108Z clusters/a6a8f0b0/namespaces/openshift-cnv/pods/virt-template-validator-5f84757967-hmwxg/webhook/webhook/logs/previous.log [must-gather-x9k62] OUT 2026-02-05T18:53:41.647702771Z clusters/a6a8f0b0/namespaces/openshift-cnv/policy/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.647777935Z clusters/a6a8f0b0/namespaces/openshift-cnv/policy/poddisruptionbudgets.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.64787469Z clusters/a6a8f0b0/namespaces/openshift-cnv/pool.kubevirt.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.647947045Z clusters/a6a8f0b0/namespaces/openshift-cnv/pool.kubevirt.io/virtualmachinepools.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.648011948Z clusters/a6a8f0b0/namespaces/openshift-cnv/route.openshift.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.648091522Z clusters/a6a8f0b0/namespaces/openshift-cnv/route.openshift.io/routes.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.648185847Z clusters/a6a8f0b0/namespaces/openshift-cnv/snapshot.kubevirt.io/ [must-gather-x9k62] OUT 2026-02-05T18:53:41.648276152Z clusters/a6a8f0b0/namespaces/openshift-cnv/snapshot.kubevirt.io/virtualmachinerestores.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.64841605Z clusters/a6a8f0b0/namespaces/openshift-cnv/snapshot.kubevirt.io/virtualmachinesnapshotcontents.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.648530386Z clusters/a6a8f0b0/namespaces/openshift-cnv/snapshot.kubevirt.io/virtualmachinesnapshots.yaml [must-gather-x9k62] OUT 2026-02-05T18:53:41.655887877Z [must-gather-x9k62] OUT 2026-02-05T18:53:41.655911068Z sent 7,138 bytes received 2,624,234 bytes 5,262,744.00 bytes/sec [must-gather-x9k62] OUT 2026-02-05T18:53:41.655917508Z total size is 39,245,326 speedup is 14.91 [must-gather ] OUT 2026-02-05T18:53:41.85611054Z namespace/openshift-must-gather-jt4xj deleted Reprinting Cluster State: When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information: ClusterID: a6a8f0b0-37da-44fd-82f5-3da5ab2e0e09 ClientVersion: 4.20.11 ClusterVersion: Stable at "4.21.0-0.nightly-2026-02-04-232248" ClusterOperators: clusteroperator/operator-lifecycle-manager is not upgradeable because ClusterServiceVersions blocking minor version upgrades to 4.22.0 or higher: - maximum supported OCP version for openshift-storage/odf-dependencies.v4.20.5-rhodf is 4.21 - maximum supported OCP version for openshift-storage/odf-operator.v4.20.5-rhodf is 4.21 Checking for additional logs in /alabama/cspi/e2e/logs Copying /alabama/cspi/e2e/logs to /logs/artifacts... It_Backup_hooks_tests_Pre_exec_hook_tc-id_OADP-92_interop_smoke_Tier0_vf_backup-hooks_Cassandra_app_with_Restic It_datamover_DataMover_Backup_Restore_stateful_application_with_CSI_tc-id_OADP-440_interop_Tier0_vf_data-mover_Cassandra_application artifacts Checking if yq exists Installing yq % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 13.0M 100 13.0M 0 0 97.1M 0 --:--:-- --:--:-- --:--:-- 97.1M Collecting original results in /logs/artifacts/original_results/ Patching Tests Result File: /logs/artifacts/junit_oadp_cnv_results.xml Mapping Test Suite Name To: OADP-lp-interop Patching Tests Result File: /logs/artifacts/junit_oadp_interop_results.xml Mapping Test Suite Name To: OADP-lp-interop Patching Tests Result File: /logs/artifacts/original_results/junit_oadp_cnv_results.xml Mapping Test Suite Name To: OADP-lp-interop Patching Tests Result File: /logs/artifacts/original_results/junit_oadp_interop_results.xml Mapping Test Suite Name To: OADP-lp-interop