Uploaded image for project: 'Cost Management'
  1. Cost Management
  2. COST-3315

Performance: Daily OCP on GCP partition into parquet

XMLWordPrintable

    • Icon: Epic Epic
    • Resolution: Done
    • Icon: Major Major
    • 2023Q2
    • None
    • Data Pipeline
    • Performance: Daily OCP on GCP partition into parquet
    • False
    • None
    • False
    • To Do
    • 100
    • 100% 100%

      The regular cloud source are partitioned by month/year/source. We are adding in a day partition for the OCP on GCP because the volume of data is still too great. We are reducing the amount of data queried during summarization.

      Trino loads the month of data and then filters it down into the dates. If we also partition by day it will only load those days of data.

            cgoodfre Corey Goodfred
            kholdawa@redhat.com Kevan Holdaway
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

              Created:
              Updated:
              Resolved: