Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-53466

Tuned plugin failing due to failing python import [RHEL 9.6]

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Critical Critical
    • None
    • 4.19
    • Node Tuning Operator
    • None
    • Approved
    • False
    • Hide

      None

      Show
      None
    • Hide
      2024-4-1:
      According to RHEL-79032, the issue is also fixed in kernel-5.14.0-570.10.1.el9_6, but none of the RHCOS versions in the CI are currently (yet) using it. The latest is 5.14.0-570.9.1.el9_6.

      There are 3 ways this can be fixed:
      1. wait for the new TuneD FDP release (workaround)
      2. wait for kernel-5.14.0-570.10.1.el9_6 (probably coming soon too, real fix - it's in 4.19.0-0.nightly-2025-04-01-154524)
      3. wait for NTO to switch to RHEL 9.6 base (probably coming later in the 4.19 timeframe, real userspace fix)

      TuneD FDP targeted to 3rd April, https://errata.devel.redhat.com/advisory/147583
      Show
      2024-4-1: According to RHEL-79032, the issue is also fixed in kernel-5.14.0-570.10.1.el9_6, but none of the RHCOS versions in the CI are currently (yet) using it. The latest is 5.14.0-570.9.1.el9_6. There are 3 ways this can be fixed: 1. wait for the new TuneD FDP release (workaround) 2. wait for kernel-5.14.0-570.10.1.el9_6 (probably coming soon too, real fix - it's in 4.19.0-0.nightly-2025-04-01-154524) 3. wait for NTO to switch to RHEL 9.6 base (probably coming later in the 4.19 timeframe, real userspace fix) TuneD FDP targeted to 3rd April, https://errata.devel.redhat.com/advisory/147583

      Due to https://issues.redhat.com/browse/RHEL-79032

      Tuned irqbalance plugin is failing to initialize:

      2025-03-21 13:37:18,832 INFO     tuned.daemon.daemon: starting tuning
2025-03-21 13:37:18,837 ERROR    tuned.units.manager: failed to initialize plugin irqbalance
2025-03-21 13:37:18,837 ERROR    tuned.units.manager: /usr/lib64/python3.9/site-packages/perf.cpython-39-x86_64-linux-gnu.so: undefined symbol: verbose
Traceback (most recent call last):
  File "/usr/lib/python3.9/site-packages/tuned/units/manager.py", line 89, in create
    plugin = self._plugins_repository.create(plugin_name)
  File "/usr/lib/python3.9/site-packages/tuned/plugins/repository.py", line 34, in create
    plugin_cls = self.load_class(plugin_name)
  File "/usr/lib/python3.9/site-packages/tuned/utils/class_loader.py", line 32, in load_class
    return self._get_class(module_name)
  File "/usr/lib/python3.9/site-packages/tuned/utils/class_loader.py", line 36, in _get_class
    module = __import__(module_name)
  File "/usr/lib/python3.9/site-packages/tuned/plugins/plugin_irqbalance.py", line 6, in <module>
    import perf
ImportError: /usr/lib64/python3.9/site-packages/perf.cpython-39-x86_64-linux-gnu.so: undefined symbol: verbose
2025-03-21 13:37:18,871 INFO     tuned.plugins.base: instance cpu: assigning devices cpu1, cpu2, cpu0, cpu3

       - Once tuned fails on setting IRQ balancing (with irqbalance pluging) this can prevent also other setting from being applied + setting the tuned profile as degraded

       - CI tests are currently failing due to this issue ([test_id:36150])

       - Opening this issue to track the RHEL issue and provide a 4.19 skip test CI until RHEL issue is resolved.

       

              yquinn@redhat.com Yanir Quinn
              yquinn@redhat.com Yanir Quinn
              Roy Shemtov Roy Shemtov
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

                Created:
                Updated: