-
Epic
-
Resolution: Done
-
Major
-
None
-
None
-
OCP on Cloud parquet processing split
-
23
-
False
-
None
-
False
-
To Do
-
0% To Do, 0% In Progress, 100% Done
OCP on Cloud parquet files are currently created during the download flow, this processing should be split into a separate celery task that runs Trino SQL. Large impact to the data processing pipeline, no impact to customer facing API/UI, update and document existing masu endpoint to use new flow.
This should be done one provider at a time in order to reduce risk.
This will be released one provider at a time to reduce risk of a larger change. AWS will be the first. Targeting stage by 2024/08/15.
- is related to
-
COST-5661 Switch OCP on Cloud summary to read from new managed trino tables
- To Do