In the openstack-operator while running the Collapsed Cell kuttl test, nova is not coming up properly.

You can see an https://prow.ci.openshift.org/view/gs/origin-ci-test/pr-logs/pull/openstack-k8s-operators_openstack-operator/388/pull-ci-openstack-k8s-operators-openstack-operator-main-openstack-operator-build-deploy-kuttl/1676975639481028608 for the https://github.com/openstack-k8s-operators/openstack-operator/pull/388 that adds status checks for the kuttl tests

This is impacting the ability to add status checks in the kuttl tests for the openstack-operator.

Reproducible locally with crc. What logs should I add?

[jparoly@fedora install_yamls]$ oc describe pod nova-cell1-cell-mapping-78j8r
Name: nova-cell1-cell-mapping-78j8r
Namespace: openstack-kuttl-tests
Priority: 0
Service Account: nova-nova
Node: crc-74q6p-master-0/192.168.126.11
Start Time: Thu, 06 Jul 2023 16:11:11 -0400
Labels: controller-uid=13aca3c3-5f11-459f-afb0-d9dc12133520
job-name=nova-cell1-cell-mapping
Annotations: k8s.v1.cni.cncf.io/network-status:
[{
"name": "openshift-sdn",
"interface": "eth0",
"ips": [
"10.217.1.211"
],
"default": true,
"dns": {}
}]
k8s.v1.cni.cncf.io/networks-status:
[{
"name": "openshift-sdn",
"interface": "eth0",
"ips": [
"10.217.1.211"
],
"default": true,
"dns": {}
}]
openshift.io/scc: anyuid
Status: Running
IP: 10.217.1.211
IPs:
IP: 10.217.1.211
Controlled By: Job/nova-cell1-cell-mapping
Containers:
nova-manage:
Container ID: cri-o://9698a9ae2268df23e6ba17c51013766c2f9191d30e60ebdb3fb9d1b8b1f9de09
Image: quay.io/podified-antelope-centos9/openstack-nova-conductor:current-podified
Image ID: quay.io/podified-antelope-centos9/openstack-nova-conductor@sha256:0e50dbd34e56079203768ccc251f4b3f2b45eaf883978f7c0d46b7a418795d87
Port: <none>
Host Port: <none>
Command:
/bin/bash
Args:
-c
/usr/local/bin/kolla_set_configs && /var/lib/openstack/bin/ensure_cell_mapping.sh
State: Waiting
Reason: CrashLoopBackOff
Last State: Terminated
Reason: Error
Exit Code: 2
Started: Thu, 06 Jul 2023 16:12:32 -0400
Finished: Thu, 06 Jul 2023 16:12:43 -0400
Ready: False
Restart Count: 3
Environment:
CELL_NAME: cell1
INPUT_HASH: n5dh5b7h59dh545h5bch645h5dfh59dh64bhc4hfbh6h8h566h5d5h98h669h644h59h77h64h566h695h94h699h68dh598h94h58h5f6hc7h588q
KOLLA_BOOTSTRAP: true
KOLLA_CONFIG_FILE: /var/lib/openstack/config/nova-manage-config.json
KOLLA_CONFIG_STRATEGY: COPY_ALWAYS
Mounts:
/var/lib/openstack/bin from scripts (rw)
/var/lib/openstack/config from config-data (rw)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-sswnx (ro)
Conditions:
Type Status
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
config-data:
Type: Secret (a volume populated by a Secret)
SecretName: nova-cell1-manage-config-data
Optional: false
scripts:
Type: Secret (a volume populated by a Secret)
SecretName: nova-cell1-manage-scripts
Optional: false
kube-api-access-sswnx:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
ConfigMapName: openshift-service-ca.crt
ConfigMapOptional: <nil>
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 117s default-scheduler Successfully assigned openstack-kuttl-tests/nova-cell1-cell-mapping-78j8r to crc-74q6p-master-0
Normal AddedInterface 115s multus Add eth0 [10.217.1.211/23] from openshift-sdn
Normal Pulled 36s (x4 over 115s) kubelet Container image "quay.io/podified-antelope-centos9/openstack-nova-conductor:current-podified" already present on machine
Normal Created 36s (x4 over 115s) kubelet Created container nova-manage
Normal Started 36s (x4 over 115s) kubelet Started container nova-manage
Warning BackOff 13s (x5 over 93s) kubelet Back-off restarting failed container