Uploaded image for project: 'Cost Management'
  1. Cost Management
  2. COST-3315

Performance: Daily OCP on GCP partition into parquet

XMLWordPrintable

    • Icon: Epic Epic
    • Resolution: Done
    • Icon: Major Major
    • 2023Q2
    • None
    • Data Pipeline
    • Performance: Daily OCP on GCP partition into parquet
    • False
    • None
    • False
    • To Do
    • 0% To Do, 0% In Progress, 100% Done

      The regular cloud source are partitioned by month/year/source. We are adding in a day partition for the OCP on GCP because the volume of data is still too great. We are reducing the amount of data queried during summarization.

      Trino loads the month of data and then filters it down into the dates. If we also partition by day it will only load those days of data.

              cgoodfre Corey Goodfred (Inactive)
              kholdawa@redhat.com Kevan Holdaway
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

                Created:
                Updated:
                Resolved: