Uploaded image for project: 'Project Quay'
  1. Project Quay
  2. PROJQUAY-1810

SPIKE: Investigate support for partitioning on some table

XMLWordPrintable

    • False
    • False
    • Quay
    • Undefined

      Some of the database tables on Quay.io are getting absurdly large.

      We should find a way to reduce the load that some queries produces when accessing some table.

      For example, the ImageStorage, Manifest, ManifestBlob tables could possibly be partitioned by a prefix on the content_digest column (i.e The first few characters of the SHA value), with changes to the application code such that only one partition is accessed at a time.

      This would reduce the sheer size of some table and queries/joins associated.

      Ref:

      https://architect.readthedocs.io/features/partition/index.html

              sleesinc Kenny Lee Sin Cheong
              sleesinc Kenny Lee Sin Cheong
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: