Uploaded image for project: 'Project Quay'
  1. Project Quay
  2. PROJQUAY-4259

Clair fails to fetch layers with error: unable to create file: open /tmp/fetch.2355163548: no space left on device

    XMLWordPrintable

Details

    • Bug
    • Resolution: Obsolete
    • Normal
    • None
    • clair-4.4.1
    • clair
    • False
    • None
    • False
    • Quay Enterprise
    • Low
    • 0

    Description

      • Clair scanning fails with above error.
      • /tmp on clair container host VM gets full.
      • exact error message:

      {"log": "

      {\"level\":\"warn\",\"manifest\":\"sha256:6d2243864f75e2046008613ebb72ab92a3ebf92cb7608f9a264e18f35bd32c85\",\"state\":\"FetchLayers\",\"component\":\"internal/indexer/controller/Controller.Index\",\"error\":\"encountered error while fetching a layer: fetcher: unable to create file: open /tmp/fetch.2355163548: no space left on device\",\"time\":\"2022-08-02T09:50:32Z\",\"message\":\"layers fetch failure\"}

      \n", "stream": "stderr", "time": "2022-08-02T09:50:32.386142917Z"}

      $ grep -i "unable to create file: open" 0020-clair-log.txt | wc -l
      16

      • Similar/relevant bug : rpm: package scanner leaks extracted layers https://issues.redhat.com/browse/PROJQUAY-2315
      • Qualcomm are running 4 instances of Clair and see 2 of them endup in with the disk filled in the /tmp partition. Is there a way to confirm the distribution across all Clair instances is working correctly?

      Attachments

        1. tmpdiskusage.op.1
          3.52 MB
        2. tmpdiskusage.op.2
          3.77 MB
        3. tmpdiskusage.op.3
          3.69 MB
        4. tmpdiskusage.op.4
          4.12 MB

        Activity

          People

            hdonnay Henry Donnay
            rhn-support-sbhavsar Sayali Bhavsar
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: