Uploaded image for project: 'Red Hat Internal Developer Platform'
  1. Red Hat Internal Developer Platform
  2. RHIDP-6683

Develop strategy for cleaning up unneeded CI tags in Quay

    • Icon: Task Task
    • Resolution: Unresolved
    • Icon: Normal Normal
    • 1.8.0
    • 1.6.0
    • Build, Operator, Performance
    • None
    • RHDH COPE 3273, RHDH COPE 3274

      Using Omar's new deleteTagsFromQuay.sh we can now scrub tags and do some perf testing on quay to see if we get fewer timeouts.

      After the 1.5.1 release, I removed some tags for the 1.0, 1.1, and 1.2 releases.

      ~/pp/deleteTagsFromQuay.sh --filter 1.0- --age "10 days" 
      ~/pp/deleteTagsFromQuay.sh --filter 1.1- --age "10 days" 
      ~/pp/deleteTagsFromQuay.sh --filter 1.2- --age "10 days" 
      

      As of 2025-03-27 11:48pm:

      repo, count
      hub: 6477
      op:  5271
      bun: 7473
      iib: 8085

      Today I purged more old / useless tags with...

      # on-pr and on-push tags, which duplicate the numbered ones 1.y-zzz
      ~/pp/deleteTagsFromQuay.sh --filter on- --age "10 days" 
      
      # old konflux-generated tags for .sbom, .src, .att, etc. 
      ~/pp/deleteTagsFromQuay.sh --filter sha256- --age "4 months" 
      

      To check overall (approx) tag count and time to read metadata:

      time sid quay.io/rhdh/rhdh-hub-rhel9:next | jq .RepoTags | wc -l; \
      time sid quay.io/rhdh/rhdh-rhel9-operator:next | jq .RepoTags | wc -l; \
      time sid quay.io/rhdh/rhdh-operator-bundle:next | jq .RepoTags | wc -l; \
      time sid quay.io/rhdh/iib:latest-v4.18-x86_64 | jq .RepoTags | wc -l
      

      -----------

      As of 2025-03-28 1:18pm:

      repo, count, time
      hub: 5803   13s
      op:  4613   43s
      bun: 6440   27s
      iib: 7514   48s
      

      DoD here is to:

      • collect more data about performance
      • decide how aggressively to purge sha256 and on tags
      • script this cleanup to happen automatically via GL crontab?

              nickboldt Nick Boldt
              nickboldt Nick Boldt
              RHIDP - Cope
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

                Created:
                Updated: