-
Task
-
Resolution: Done
-
Critical
-
None
-
None
The changes introduced in COST-2682 will be breaking changes in production due to:
- The new naming convention for our csv & parquet files in trino
- The new assembly id format we use in our manifest records
In order to not break our GCP sources for our customers we will need to implement some self healing logic that does the following:
- Identifies gcp manifests related to our old downloader
- Removes the csv & parquet files for those manifests
- Deletes the manifests themselves from our database
- Resets the setup_complete flag for the provider
- Retriggers an initial download to recollect the gcp csv files and recreate the parquet files
- Can be run multiple times without affecting new manifests created by the new gcp downloader.
This issue is to design and implement some some self healing code that will handle the above mentioned acceptance criteria.
- is related to
-
COST-2810 Remove self healing code after transitioning to the new gcp downloader.
- Closed