[zuul@controller-0 ~]$ oc rsh -c nova-api-api nova-api-0 sh-5.1$ rpm -qa | grep nova python3-novaclient-18.3.0-18.0.20240620173053.85e4f08.el9osttrunk.noarch python3-nova-27.5.2-18.0.20250407212402.c1c6d67.el9.noarch openstack-nova-common-27.5.2-18.0.20250407212402.c1c6d67.el9.noarch openstack-nova-api-27.5.2-18.0.20250407212402.c1c6d67.el9.noarch # Confirm decorator is present sh-5.1$ rpm -ql python3-nova-27.5.2-18.0.20250407212402.c1c6d67.el9.noarch | grep nova/api/openstack/wsgi_app.py /usr/lib/python3.9/site-packages/nova/api/openstack/wsgi_app.py sh-5.1$ view /usr/lib/python3.9/site-packages/nova/api/openstack/wsgi_app.py +120 # Updated controlplane with: nova: apiOverride: route: {} enabled: true template: apiDatabaseAccount: nova-api apiDatabaseInstance: openstack apiMessageBusInstance: rabbitmq apiServiceTemplate: customServiceConfig: | [DEFAULT] metadata_workers = 0 [zuul@controller-0 ~]$ oc edit osctlplane controlplane openstackcontrolplane.core.openstack.org/controlplane edited zuul@controller-0 ~]$ oc get pods | grep nova-api nova-api-0 2/2 Running 0 19h nova-api-1 2/2 Running 0 19h nova-api-2 0/2 ContainerCreating 0 1s [zuul@controller-0 ~]$ oc get pods | grep nova-api nova-api-0 2/2 Running 0 19h nova-api-1 2/2 Running 0 19h nova-api-2 0/2 Running 0 10s [zuul@controller-0 ~]$ oc get pods | grep nova-api nova-api-0 2/2 Running 0 19h nova-api-1 2/2 Running 0 19h nova-api-2 0/2 Running 0 49s [zuul@controller-0 ~]$ oc logs nova-api-2 -f -c nova-api-api + sudo -E kolla_set_configs sudo: unable to send audit message: Operation not permitted INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json INFO:__main__:Validating config file INFO:__main__:Kolla config strategy set to: COPY_ALWAYS INFO:__main__:Copying service configuration files INFO:__main__:Deleting /etc/nova/nova.conf INFO:__main__:Copying /var/lib/openstack/config/nova-blank.conf to /etc/nova/nova.conf INFO:__main__:Setting permission for /etc/nova/nova.conf INFO:__main__:Copying /var/lib/openstack/config/01-nova.conf to /etc/nova/nova.conf.d/01-nova.conf INFO:__main__:Setting permission for /etc/nova/nova.conf.d/01-nova.conf INFO:__main__:Copying /var/lib/openstack/config/02-nova-override.conf to /etc/nova/nova.conf.d/02-nova-override.conf INFO:__main__:Setting permission for /etc/nova/nova.conf.d/02-nova-override.conf INFO:__main__:Deleting /etc/httpd/conf/httpd.conf INFO:__main__:Copying /var/lib/openstack/config/httpd.conf to /etc/httpd/conf/httpd.conf INFO:__main__:Setting permission for /etc/httpd/conf/httpd.conf INFO:__main__:Deleting /etc/httpd/conf.d/ssl.conf INFO:__main__:Copying /var/lib/openstack/config/ssl.conf to /etc/httpd/conf.d/ssl.conf INFO:__main__:Setting permission for /etc/httpd/conf.d/ssl.conf INFO:__main__:Copying /var/lib/config-data/tls/certs/internal.crt to /etc/pki/tls/certs/internal.crt INFO:__main__:Setting permission for /etc/pki/tls/certs/internal.crt INFO:__main__:Copying /var/lib/config-data/tls/certs/public.crt to /etc/pki/tls/certs/public.crt INFO:__main__:Setting permission for /etc/pki/tls/certs/public.crt INFO:__main__:Copying /var/lib/config-data/tls/private/internal.key to /etc/pki/tls/private/internal.key INFO:__main__:Setting permission for /etc/pki/tls/private/internal.key INFO:__main__:Copying /var/lib/config-data/tls/private/public.key to /etc/pki/tls/private/public.key INFO:__main__:Setting permission for /etc/pki/tls/private/public.key INFO:__main__:Copying /var/lib/openstack/config/my.cnf to /etc/my.cnf INFO:__main__:Setting permission for /etc/my.cnf INFO:__main__:Writing out command to execute INFO:__main__:Setting permission for /var/log/nova INFO:__main__:Setting permission for /etc/httpd/run/ INFO:__main__:Setting permission for /etc/httpd/run/htcacheclean ++ cat /run_command + CMD='/usr/sbin/httpd -DFOREGROUND' + ARGS= + sudo kolla_copy_cacerts sudo: unable to send audit message: Operation not permitted + [[ ! -n '' ]] + . kolla_extend_start + echo 'Running command: '\''/usr/sbin/httpd -DFOREGROUND'\''' Running command: '/usr/sbin/httpd -DFOREGROUND' + umask 0022 + exec /usr/sbin/httpd -DFOREGROUND [Tue Apr 08 19:01:19.019722 2025] [ssl:info] [pid 1:tid 1] AH01883: Init: Initialized OpenSSL library AH01914: Configuring server nova-public.openstack.svc:443 for SSL protocol [Tue Apr 08 19:01:19.021210 2025] [ssl:info] [pid 1:tid 1] AH01887: Init: Initializing (virtual) servers for SSL ... AH00834: leaving socache_shmcb_store successfully mod_wsgi (pid=16, process='internal', application=''): Loading Python script file '/usr/bin/nova-api-wsgi'. AH02034: Initial (No.1) HTTPS request received for child 2 (server nova-internal.openstack.svc:443) AH01628: authorization result: granted (no directives) mod_wsgi (pid=15, process='internal', application=''): Loading Python script file '/usr/bin/nova-api-wsgi'. [Tue Apr 08 19:01:28.075515 2025] [wsgi:info] [pid 134:tid 134] mod_wsgi (pid=134): Initializing Python. Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. [Tue Apr 08 19:01:28.121435 2025] [wsgi:info] [pid 134:tid 134] mod_wsgi (pid=134): Attach interpreter ''. [Tue Apr 08 19:01:28.128621 2025] [wsgi:info] [pid 134:tid 134] mod_wsgi (pid=134): Imported 'mod_wsgi'. Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. mod_wsgi (pid=15): Failed to exec Python script file '/usr/bin/nova-api-wsgi'. mod_wsgi (pid=15): Exception occurred processing WSGI script '/usr/bin/nova-api-wsgi'. Traceback (most recent call last): File "/usr/lib/python3.9/site-packages/oslo_config/cfg.py", line 2716, in _do_get return (convert(val), alt_loc) File "/usr/lib/python3.9/site-packages/oslo_config/cfg.py", line 2685, in convert return self._convert_value( File "/usr/lib/python3.9/site-packages/oslo_config/cfg.py", line 2813, in _convert_value return opt.type(value) File "/usr/lib/python3.9/site-packages/oslo_config/types.py", line 315, in __call__ raise ValueError('Should be greater than or equal to %g' % ValueError: Should be greater than or equal to 1 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/bin/nova-api-wsgi", line 52, in application = init_application() File "/usr/lib/python3.9/site-packages/nova/api/openstack/compute/wsgi.py", line 20, in init_application return wsgi_app.init_application(NAME) File "/usr/lib/python3.9/site-packages/nova/utils.py", line 1169, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.9/site-packages/nova/api/openstack/wsgi_app.py", line 130, in init_application init_global_data(conf_files, name) File "/usr/lib/python3.9/site-packages/nova/utils.py", line 1124, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.9/site-packages/nova/api/openstack/wsgi_app.py", line 115, in init_global_data CONF.log_opt_values( File "/usr/lib/python3.9/site-packages/oslo_config/cfg.py", line 2603, in log_opt_values _sanitize(opt, getattr(self, opt_name))) File "/usr/lib/python3.9/site-packages/oslo_config/cfg.py", line 2219, in __getattr__ return self._get(name) File "/usr/lib/python3.9/site-packages/oslo_config/cfg.py", line 2653, in _get value, loc = self._do_get(name, group, namespace) File "/usr/lib/python3.9/site-packages/oslo_config/cfg.py", line 2732, in _do_get raise ConfigFileValueError(message) oslo_config.cfg.ConfigFileValueError: Value for option metadata_workers from LocationInfo(location=, detail='/etc/nova/nova.conf.d/02-nova-override.conf') is not valid: Should be greater than or equal to 1 192.168.24.2 - - [08/Apr/2025:19:01:27 +0000] "GET / HTTP/1.1" 500 531 "-" "kube-probe/1.29" AH02001: Connection closed to child 2 with standard shutdown (server nova-internal.openstack.svc:443) mod_wsgi (pid=16): Failed to exec Python script file '/usr/bin/nova-api-wsgi'. mod_wsgi (pid=16): Exception occurred processing WSGI script '/usr/bin/nova-api-wsgi'. Traceback (most recent call last): File "/usr/lib/python3.9/site-packages/oslo_config/cfg.py", line 2716, in _do_get return (convert(val), alt_loc) File "/usr/lib/python3.9/site-packages/oslo_config/cfg.py", line 2685, in convert return self._convert_value( File "/usr/lib/python3.9/site-packages/oslo_config/cfg.py", line 2813, in _convert_value return opt.type(value) File "/usr/lib/python3.9/site-packages/oslo_config/types.py", line 315, in __call__ raise ValueError('Should be greater than or equal to %g' % ValueError: Should be greater than or equal to 1 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/bin/nova-api-wsgi", line 52, in application = init_application() File "/usr/lib/python3.9/site-packages/nova/api/openstack/compute/wsgi.py", line 20, in init_application return wsgi_app.init_application(NAME) File "/usr/lib/python3.9/site-packages/nova/utils.py", line 1169, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.9/site-packages/nova/api/openstack/wsgi_app.py", line 130, in init_application init_global_data(conf_files, name) File "/usr/lib/python3.9/site-packages/nova/utils.py", line 1124, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.9/site-packages/nova/api/openstack/wsgi_app.py", line 115, in init_global_data CONF.log_opt_values( File "/usr/lib/python3.9/site-packages/oslo_config/cfg.py", line 2603, in log_opt_values _sanitize(opt, getattr(self, opt_name))) File "/usr/lib/python3.9/site-packages/oslo_config/cfg.py", line 2219, in __getattr__ return self._get(name) File "/usr/lib/python3.9/site-packages/oslo_config/cfg.py", line 2653, in _get value, loc = self._do_get(name, group, namespace) File "/usr/lib/python3.9/site-packages/oslo_config/cfg.py", line 2732, in _do_get raise ConfigFileValueError(message) oslo_config.cfg.ConfigFileValueError: Value for option metadata_workers from LocationInfo(location=, detail='/etc/nova/nova.conf.d/02-nova-override.conf') is not valid: Should be greater than or equal to 1 192.168.24.2 - - [08/Apr/2025:19:01:27 +0000] "GET / HTTP/1.1" 500 531 "-" "kube-probe/1.29" AH02001: Connection closed to child 0 with standard shutdown (server nova-internal.openstack.svc:443) # Above Failure continues and never transitions over to applying the configuration.