Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-17569

CI: 4.14-ocp-e2e-ovn-remote-libvirt-s390x: Few of the tests are failing with "The node was low on resource: ephemeral-storage"

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Normal Normal
    • None
    • 4.14
    • None
    • Moderate
    • No
    • Multi-Arch Sprint 241, Multi-Arch Sprint 242, Multi-Arch Sprint 243, Multi-Arch Sprint 244
    • 4
    • s390x
    • False
    • Hide

      None

      Show
      None

      JOB: https://prow.ci.openshift.org/view/gs/origin-ci-test/logs/periodic-ci-openshift-multiarch-master-nightly-4.14-ocp-e2e-ovn-remote-libvirt-s390x/1686762749809397760
      LPAR:-
      Acquired 1 lease(s) for libvirt-s390x-quota-slice: [libvirt-s390x-2-0]

      Test case :-
      [sig-builds][Feature:Builds][pullsecret] docker build using a pull secret Building from a template should create a docker build that pulls using a secret run it [apigroup:build.openshift.io] [Skipped:Disconnected] [Suite:openshift/conformance/parallel]

      Failed with reason

      { fail [github.com/openshift/origin/test/extended/builds/docker_pullsecret.go:50]: Expected <bool>: false to be true Ginkgo exit error 1: exit with code 1}

      Aug 2 17:12:24.461: INFO: Waiting for docker-build-1 to complete

      Aug 2 17:20:35.966: INFO: WaitForABuild returning with error: The build "docker-build-1" status is "Failed"
      Aug 2 17:20:35.966: INFO: Done waiting for docker-build-1: util.BuildResult

      {BuildPath:"build.build.openshift.io/docker-build-1", BuildName:"docker-build-1", StartBuildStdErr:"", StartBuildStdOut:"build.build.openshift.io/docker-build-1", StartBuildErr:error(nil), BuildConfigName:"", Build:(*v1.Build)(0xc0003f0d80), BuildAttempt:true, BuildSuccess:false, BuildFailure:true, BuildCancelled:false, BuildTimeout:false, LogDumper:(util.LogDumperFunc)(nil), Oc:(*util.CLI)(0xc002232780)}

      with error: The build "docker-build-1" status is "Failed"

      Aug 2 17:20:35.966: INFO:

      *****************************************

      Aug 2 17:20:35.966: INFO: Dumping Build Result: util.BuildResult

      {BuildPath:"build.build.openshift.io/docker-build-1", BuildName:"docker-build-1", StartBuildStdErr:"", StartBuildStdOut:"build.build.openshift.io/docker-build-1", StartBuildErr:error(nil), BuildConfigName:"", Build:(*v1.Build)(0xc0003f0d80), BuildAttempt:true, BuildSuccess:false, BuildFailure:true, BuildCancelled:false, BuildTimeout:false, LogDumper:(util.LogDumperFunc)(nil), Oc:(*util.CLI)(0xc002232780)}

      Aug 2 17:20:35.966: INFO: Running 'oc --namespace=e2e-test-docker-build-pullsecret-r2zcw --kubeconfig=/tmp/configfile1952543610 describe build.build.openshift.io/docker-build-1'
      Aug 2 17:20:38.258: INFO:

        • Build Description:

      Aug 2 17:20:38.258: INFO: Name: docker-build-1
      Namespace: e2e-test-docker-build-pullsecret-r2zcw
      Created: 8 minutes ago
      Labels: buildconfig=docker-build
      name=docker-build
      openshift.io/build-config.name=docker-build
      openshift.io/build.start-policy=Serial
      Annotations: openshift.io/build-config.name=docker-build
      openshift.io/build.number=1
      openshift.io/build.pod-name=docker-build-1-build

      Status: Failed (The node was low on resource: ephemeral-storage. Threshold quantity: 4761213731, available: 4057476Ki. Container docker-build was using 320432Ki, request is 0, has larger consumption of ephemeral-storage. )
      Started: Wed, 02 Aug 2023 17:12:24 UTC
      Duration: 8m8s

      Build Config: docker-build
      Build Pod: docker-build-1-build

      Strategy: Docker
      Dockerfile:
      FROM image-registry.openshift-image-registry.svc:5000/openshift/tools:latest
      From Image: DockerImage image-registry.openshift-image-registry.svc:5000/openshift/tools:latest
      Pull Secret Name: builder-dockercfg-p647p
      Volumes: <none>
      Output to: ImageStreamTag image1:latest
      Empty Source: no input source provided
      Push Secret: builder-dockercfg-p647p

      Build trigger cause: Manually triggered

      Log Tail: The container could not be located when the pod was terminated
      Events:
      Type Reason Age From Message
      ---- ------ ---- ---- -------
      Normal Scheduled 8m14s default-scheduler Successfully assigned e2e-test-docker-build-pullsecret-r2zcw/docker-build-1-build to libvirt-s390x-2-0-b66-lwzsp-worker-0-dmtwl
      Normal AddedInterface 8m13s multus Add eth0 [10.131.0.148/23] from ovn-kubernetes
      Normal Pulled 8m13s kubelet Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:821d41e08bde6b3586879ebfd53b83297da48bac4d9cb6f1ff47c69e5334109c" already present on machine
      Normal Created 8m13s kubelet Created container manage-dockerfile
      Normal Started 8m13s kubelet Started container manage-dockerfile
      Normal Pulled 8m12s kubelet Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:821d41e08bde6b3586879ebfd53b83297da48bac4d9cb6f1ff47c69e5334109c" already present on machine
      Normal BuildStarted 8m11s build-controller Build e2e-test-docker-build-pullsecret-r2zcw/docker-build-1 is now running
      Normal Created 8m11s kubelet Created container docker-build
      Normal Started 8m11s kubelet Started container docker-build
      Warning Evicted 8s kubelet The node was low on resource: ephemeral-storage. Threshold quantity: 4761213731, available: 4057476Ki. Container docker-build was using 320432Ki, request is 0, has larger consumption of ephemeral-storage.
      Normal Killing 8s kubelet Stopping container docker-build
      Normal BuildFailed 6s build-controller Build e2e-test-docker-build-pullsecret-r2zcw/docker-build-1 failed

      Root cause:-

      Warning Evicted 8s kubelet The node was low on resource: ephemeral-storage. Threshold quantity: 4761213731, available: 4057476Ki. Container docker-build was using 320432Ki, request is 0, has larger consumption of ephemeral-storage.
      Normal Killing 8s kubelet Stopping container docker-build

              apuranda Amrut Purandare
              apuranda Amrut Purandare
              Florian Leber Florian Leber
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

                Created:
                Updated:
                Resolved: