Uploaded image for project: 'CoreOS OCP'
  1. CoreOS OCP
  2. COS-3915 Pipeline monitoring w.s 23022026
  3. COS-3957

build-arch #3545 - 4.17-9.4 s390x - Kubernetes CPU quota exceeded

XMLWordPrintable

    • Icon: Sub-task Sub-task
    • Resolution: Done
    • Icon: Undefined Undefined
    • None
    • None
    • False
    • Hide

      None

      Show
      None
    • False
    • CoreOS East - Sprint 284

      Build Details

      Field Value
      Job build-arch
      Build Number #3545
      Stream 4.17-9.4
      Arch s390x
      Build ID 417.94.202602241014-0
      Timestamp 2026-02-24T13:05:57
      Duration ~60 minutes
      Jenkins URL https://jenkins-rhcos--prod-pipeline.apps.int.prod-stable-spoke1-dc-iad2.itup.redhat.com/job/build-arch/3545/

      Root Cause Analysis

      The build failed because the Kubernetes cluster exceeded its CPU quota when trying to launch pods.

      Error Message

      Failure executing: POST at: [https://172.30.0.1:443/api/v1/namespaces/rhcos\-\-prod\-pipeline/pods|https://172.30.0.1:443/api/v1/namespaces/rhcos--prod-pipeline/pods].
      Message: pods "pod\-f52cdf84\-cc2f\-469a\-83d1\-a253643cae18\-nrnw2\-v566x" is forbidden:
      exceeded quota: rhcos\-\-notterminating, requested: requests.cpu=2, used: requests.cpu=30850m, limited: requests.cpu=32
      

      Analysis

      This is a transient infrastructure issue. The OpenShift cluster hosting the Jenkins pipeline had too many concurrent jobs running and hit its CPU resource quota limit (32 CPU cores). The build couldn't schedule new pods.

      The build was triggered by upstream build #3445.

      Resolution

      This is a transient flake - retry the build when cluster resources are available. Consider:
      1. Monitoring cluster resource usage
      2. Adjusting quota limits if this becomes frequent
      3. Implementing better job scheduling/queuing

              rh-ee-rchandar Roshan Chandar
              cverna@redhat.com Clément Verna
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: