Uploaded image for project: 'Project Quay'
  1. Project Quay
  2. PROJQUAY-4259

Clair fails to fetch layers with error: unable to create file: open /tmp/fetch.2355163548: no space left on device

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Obsolete
    • Icon: Normal Normal
    • None
    • clair-4.4.1
    • clair
    • False
    • None
    • False
    • Quay Enterprise
    • Low

      • Clair scanning fails with above error.
      • /tmp on clair container host VM gets full.
      • exact error message:

      {"log": "

      {\"level\":\"warn\",\"manifest\":\"sha256:6d2243864f75e2046008613ebb72ab92a3ebf92cb7608f9a264e18f35bd32c85\",\"state\":\"FetchLayers\",\"component\":\"internal/indexer/controller/Controller.Index\",\"error\":\"encountered error while fetching a layer: fetcher: unable to create file: open /tmp/fetch.2355163548: no space left on device\",\"time\":\"2022-08-02T09:50:32Z\",\"message\":\"layers fetch failure\"}

      \n", "stream": "stderr", "time": "2022-08-02T09:50:32.386142917Z"}

      $ grep -i "unable to create file: open" 0020-clair-log.txt | wc -l
      16

      • Similar/relevant bug : rpm: package scanner leaks extracted layers https://issues.redhat.com/browse/PROJQUAY-2315
      • Qualcomm are running 4 instances of Clair and see 2 of them endup in with the disk filled in the /tmp partition. Is there a way to confirm the distribution across all Clair instances is working correctly?

        1. tmpdiskusage.op.1
          3.52 MB
          Sayali Bhavsar
        2. tmpdiskusage.op.2
          3.77 MB
          Sayali Bhavsar
        3. tmpdiskusage.op.3
          3.69 MB
          Sayali Bhavsar
        4. tmpdiskusage.op.4
          4.12 MB
          Sayali Bhavsar

              hdonnay Henry Donnay
              rhn-support-sbhavsar Sayali Bhavsar
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: