Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-56528

tuned pods fail : OSError: Error while polling fd: 4

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Duplicate
    • Icon: Undefined Undefined
    • None
    • 4.17
    • Node Tuning Operator
    • None
    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • None
    • Moderate
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      tuned pod(s) fail sporadically with next error message:

      I0520 19:35:00.812474    7314 controller.go:839] tunedReload()
      I0520 19:35:00.812507    7314 controller.go:766] starting tuned...
      I0520 19:35:00.812520    7314 run.go:103] running cmd...
      2025-05-20 19:35:00,950 INFO     tuned.daemon.application: TuneD: 2.25.1, kernel: 5.14.0-427.68.1.el9_4.x86_64
      2025-05-20 19:35:00,950 INFO     tuned.daemon.application: dynamic tuning is globally disabled
      2025-05-20 19:35:00,958 INFO     tuned.daemon.daemon: using sleep interval of 1 second(s)
      2025-05-20 19:35:00,959 INFO     tuned.daemon.daemon: Running in automatic mode, checking what profile is recommended for your configuration.
      2025-05-20 19:35:00,959 INFO     tuned.daemon.daemon: Using 'openshift-control-plane' profile
      2025-05-20 19:35:00,960 INFO     tuned.profiles.loader: loading profile: openshift-control-plane
      2025-05-20 19:35:01,023 INFO     tuned.daemon.controller: starting controller
      2025-05-20 19:35:01,023 INFO     tuned.daemon.controller: waiting for udev to settle
      Traceback (most recent call last):
        File "/usr/sbin/tuned", line 98, in <module>
          app.run(args.daemon)
        File "/usr/lib/python3.9/site-packages/tuned/daemon/application.py", line 215, in run
          result = self._controller.run()
        File "/usr/lib/python3.9/site-packages/tuned/daemon/controller.py", line 68, in run
          p = monitor.poll(timeout = 1)
        File "/usr/lib/python3.9/site-packages/pyudev/monitor.py", line 354, in poll
          if eintr_retry_call(poll.Poll.for_events((self, 'r')).poll, timeout):
        File "/usr/lib/python3.9/site-packages/pyudev/_util.py", line 159, in eintr_retry_call
          return func(*args, **kwargs)
        File "/usr/lib/python3.9/site-packages/pyudev/_os/poll.py", line 94, in poll
          return list(
        File "/usr/lib/python3.9/site-packages/pyudev/_os/poll.py", line 110, in _parse_events
          raise IOError('Error while polling fd: {0!r}'.format(fd))
      OSError: Error while polling fd: 4
      E0520 19:35:01.804202    7314 controller.go:784] Error while running tuned error waiting for tuned: exit status 1
      

      and profiles on the node with failed tuned pods don't have status:

      oc get profiles.tuned.openshift.io -A
      NAMESPACE                                NAME                                               TUNED                                  APPLIED   DEGRADED   MESSAGE                  AGE
      openshift-cluster-node-tuning-operator   openshift-master-0.qe.redhat.com   openshift-control-plane                                                              35m
      openshift-cluster-node-tuning-operator   openshift-master-1.qe.redhat.com   openshift-control-plane                True      False      TuneD profile applied.   65m
      openshift-cluster-node-tuning-operator   openshift-master-2.qe.redhat.com   openshift-control-plane                                                              98m
      openshift-cluster-node-tuning-operator   openshift-worker-0.qe.redhat.com   openshift-node                         True      False      TuneD profile applied.   84m
      openshift-cluster-node-tuning-operator   openshift-worker-1.qe.redhat.com   openshift-node                         True      False      TuneD profile applied.   84m
      openshift-cluster-node-tuning-operator   openshift-worker-2.qe.redhat.com   openshift-node-performance-customcnf   True      False      TuneD profile applied.   84m
      openshift-cluster-node-tuning-operator   openshift-worker-3.qe.redhat.com   openshift-node-performance-customcnf   True      False      TuneD profile applied.   84m
      

              team-nto Team NTO
              yprokule@redhat.com Yurii Prokulevych
              None
              None
              Liquan Cui Liquan Cui
              None
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: