Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-14713

[performance] Checking IRQBalance settings Verify irqbalance configuration handling Should not overwrite the banned CPU set on tuned restart

XMLWordPrintable

      Description of problem:

      Test fails always in Upstream Ci version 4.13 (in 4.12 and 4.11 passed recently)

      Version-Release number of selected component (if applicable):

      4.13

      How reproducible:

      CI job

      Steps to Reproduce:

      info from test:
      
      Jun  7 15:08:53.540: [INFO]: banned CPUs on "cnfdu1" when test begins: {}
      Jun  7 15:08:53.601: [INFO]: found mcd machine-config-daemon-d22zf for node cnfdu1
      Jun  7 15:08:54.167: [INFO]: found mcd machine-config-daemon-d22zf for node cnfdu1
      Jun  7 15:08:56.509: [INFO]: using testpod:
      {"metadata":{"generateName":"test-","namespace":"performance-addon-operators-testing","creationTimestamp":null,"labels":{"test":""},"annotations":{"cpu-quota.crio.io":"disable","irq-load-balancing.crio.io":"disable"}},"spec":{"containers":[{"name":"test","image":"quay.io/openshift-kni/cnf-tests:4.13","command":["sleep","10h"],"resources":{"limits":{"cpu":"2","memory":"256Mi"}}}],"nodeName":"cnfdu1","runtimeClassName":"performance-performance"},"status":{}}
      Jun  7 15:18:56.843: [WARNING]: ->  AddedInterface Add eth0 [10.135.0.76/23] from ovn-kubernetes
      Jun  7 15:18:56.843: [WARNING]: ->  Pulled Container image "quay.io/openshift-kni/cnf-tests:4.13" already present on machine
      Jun  7 15:18:56.843: [WARNING]: ->  Created Created container test
      Jun  7 15:18:56.843: [WARNING]: ->  Failed Error: failed to run pre-start hook for container "test": set CPU CFS quota: invalid slice name: /kubepods.slice
      Jun  7 15:18:56.843: [INFO]: deleting pod "test-hkxnh"
      Jun  7 15:19:01.187: [INFO]: found mcd machine-config-daemon-d22zf for node cnfdu1
      Jun  7 15:19:01.737: [INFO]: banned CPUs setting: "IRQBALANCE_BANNED_CPUS=\"00000000,00000000,00000000,00000000\""
      Jun  7 15:19:01.737: [INFO]: banned CPUs: "00000000,00000000,00000000,00000000"
      Jun  7 15:19:01.737: [INFO]: banned CPUs on "cnfdu1" when test ends: {}
      Jun  7 15:19:01.801: [INFO]: found mcd machine-config-daemon-d22zf for node cnfdu1
      Jun  7 15:19:02.417: [INFO]: IRQ Default affinity on "cnfdu1" when test ends: {ffff,ffffffff,ffffffff,ffffffff}
      [FAILED] Unexpected error:
          <*errors.errorString | 0xc0004570b0>: {
              s: "timed out waiting for the condition",
          }
          timed out waiting for the condition
      occurred
      In [It] at: /tmp/cnf-y3kqb/cnf-features-deploy/vendor/github.com/openshift/cluster-node-tuning-operator/test/e2e/performanceprofile/functests/1_performance/irqbalance.go:226 @ 06/07/23 15:19:02.417
      < Exit [It] Should not overwrite the banned CPU set on tuned restart - /tmp/cnf-y3kqb/cnf-features-deploy/vendor/github.com/openshift/cluster-node-tuning-operator/test/e2e/performanceprofile/functests/1_performance/irqbalance.go:159 @ 06/07/23 15:19:02.417 (10m14.755s)
      > Enter [ReportAfterEach] TOP-LEVEL - /tmp/cnf-y3kqb/cnf-features-deploy/cnf-tests/testsuites/e2esuite/test_suite_test.go:128 @ 06/07/23 15:19:02.418
      < Exit [ReportAfterEach] TOP-LEVEL - /tmp/cnf-y3kqb/cnf-features-deploy/cnf-tests/testsuites/e2esuite/test_suite_test.go:128 @ 06/07/23 15:19:38.818 (36.4s)
       

      Actual results:

      https://gcsweb-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/origin-ci-test/logs/periodic-ci-openshift-release-master-nightly-4.13-e2e-telco5g-cnftests/1666445676524867584/artifacts/e2e-telco5g-cnftests/telco5g-cnf-tests/artifacts/test_results.html 

      Expected results:

      pass

      Additional info:

      See stats:
      https://snapshots.raintank.io/dashboard/snapshot/MAD8R6mSFmmYwftvV4SoOR179uagcxOJ 

              yquinn@redhat.com Yanir Quinn
              sshnaidm@redhat.com Sagi Shnaidman
              Nikita Kononov Nikita Kononov
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated:
                Resolved: