Uploaded image for project: 'Red Hat OpenStack Services on OpenShift'
  1. Red Hat OpenStack Services on OpenShift
  2. OSPRH-14651

CI job edpm-ansible-molecule-edpm_nova no longer passes on main

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Blocker Blocker
    • rhos-18.0.6
    • None
    • edpm-ansible
    • None
    • Critical

      To Reproduce Steps to reproduce the behavior:

      1. Run CI job edpm-ansible-molecule-edpm_nova for any edpm patch or main, or debug it with autohold downstream https://gitlab.cee.redhat.com/ci-framework/ci-framework-testproject/-/merge_requests/1127
      2. See the ansible logs for molecule, also edpm_nova_compute service status if reproducing locally/on autohold
      3. Scroll down to "TASK [Assert systemd unit is running edpm_nova_compute.service]" or, if reproducing locally to journal records like:
      4. Mar 11 14:02:54 np0000183969 nova_compute[39499]: + exec nova-compute
        Mar 11 14:02:54 np0000183969 nova_compute[39499]: Traceback (most recent call last):
        Mar 11 14:02:54 np0000183969 nova_compute[39499]:   File "/usr/bin/nova-compute", line 6, in <module>
        Mar 11 14:02:54 np0000183969 nova_compute[39499]:     from nova.cmd.compute import main
        Mar 11 14:02:54 np0000183969 nova_compute[39499]:   File "/usr/lib/python3.9/site-packages/nova/cmd/compute.py", line 28, in <module>
        Mar 11 14:02:54 np0000183969 nova_compute[39499]:     from nova.compute import rpcapi as compute_rpcapi
        Mar 11 14:02:54 np0000183969 nova_compute[39499]:   File "/usr/lib/python3.9/site-packages/nova/compute/rpcapi.py", line 23, in <module>
        Mar 11 14:02:54 np0000183969 nova_compute[39499]:     import nova.conf
        Mar 11 14:02:54 np0000183969 nova_compute[39499]:   File "/usr/lib/python3.9/site-packages/nova/conf/__init__.py", line 26, in <module>
        Mar 11 14:02:54 np0000183969 nova_compute[39499]:     from nova.conf import cinder
        Mar 11 14:02:54 np0000183969 nova_compute[39499]:   File "/usr/lib/python3.9/site-packages/nova/conf/cinder.py", line 16, in <module>
        Mar 11 14:02:54 np0000183969 nova_compute[39499]:     from keystoneauth1 import loading as ks_loading
        Mar 11 14:02:54 np0000183969 nova_compute[39499]:   File "/usr/lib/python3.9/site-packages/keystoneauth1/loading/__init__.py", line 15, in <module>
        Mar 11 14:02:54 np0000183969 nova_compute[39499]:     from keystoneauth1.loading import adapter
        Mar 11 14:02:54 np0000183969 nova_compute[39499]:   File "/usr/lib/python3.9/site-packages/keystoneauth1/loading/adapter.py", line 13, in <module>
        Mar 11 14:02:54 np0000183969 nova_compute[39499]:     from keystoneauth1 import adapter
        Mar 11 14:02:54 np0000183969 nova_compute[39499]:   File "/usr/lib/python3.9/site-packages/keystoneauth1/adapter.py", line 16, in <module>
        Mar 11 14:02:54 np0000183969 nova_compute[39499]:     import requests
        Mar 11 14:02:54 np0000183969 nova_compute[39499]:   File "/usr/lib/python3.9/site-packages/requests/__init__.py", line 121, in <module>
        Mar 11 14:02:54 np0000183969 nova_compute[39499]:     from .api import request, get, head, post, patch, put, delete, options
        Mar 11 14:02:54 np0000183969 nova_compute[39499]:   File "/usr/lib/python3.9/site-packages/requests/api.py", line 13, in <module>
        Mar 11 14:02:54 np0000183969 nova_compute[39499]:     from . import sessions
        Mar 11 14:02:54 np0000183969 nova_compute[39499]:   File "/usr/lib/python3.9/site-packages/requests/sessions.py", line 28, in <module>
        Mar 11 14:02:54 np0000183969 nova_compute[39499]:     from .adapters import HTTPAdapter
        Mar 11 14:02:54 np0000183969 nova_compute[39499]:   File "/usr/lib/python3.9/site-packages/requests/adapters.py", line 60, in <module>
        Mar 11 14:02:54 np0000183969 nova_compute[39499]:     _preloaded_ssl_context.load_verify_locations(
        Mar 11 14:02:54 np0000183969 nova_compute[39499]: PermissionError: [Errno 13] Permission denied 

      Expected behavior

      • edpm-ansible-molecule-edpm_nova should be passing

      Screenshots

      •  

      Device Info (please complete the following information):

        •  

      Bug impact

      • No changes to nova and libvirt EDPM roles could be landed, CI is blocked, fixes targeting rhos-18.0.6 cannot be shipped

      Known workaround

      • disable edpm-ansible-molecule-edpm_nova should until fixed

      Additional context

      • other deployment CI jobs are NOT affected:
        • podified-multinode-edpm-deployment-crc upstream, 
        • component-compute-edpm-rhel9-rhoso18.0-crc-local-storage downstream
        • component-compute-edpm-rhel9-rhoso18.0-crc-ceph downstream
      • Based on tracepack, it should be related to permissions of cert files in TLS setup
      • The last pass for that job is dated by Jan 23 2025, so we need periodic jobs to catch regressions like that

              bdobreli@redhat.com Bohdan Dobrelia
              bdobreli@redhat.com Bohdan Dobrelia
              rhos-workloads-compute
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: