User Story

As a user I want to be able to add my oracle cloud account as a source to cost management.

Prioritization / Business Case

This is a new source type for HCS

Impacts

• Data Engineering
• Database
• UI
• UX

External Dependencies

Platform sources needs to add OCI to enable it for cost management

UX/UI Requirements

Is completion of a design/mock a prerequisite to working this epic or can portions be done concurrently?

• This can be worked in parallel but will require sources wizard pages for adding the new source type

Backend Requirements

Data Side

• Nise data for OCI
• Downloader – used OCI Python library to download report and send to S3
• Local downloader – if we want to follow the current convention
• Processor - take that report file and convert to parquet and send to S3
• Pandas util to make daily data and store in daily table in Trino
• Summary processor - SQL to make daily summary table
• Model files for Postgres
• daily summary table
• Tag summary tables
• Partition tables (What used to be mat views)

API/UI Side

• Sources integration/Sources wizard
• Updated provider type

QE Requirements

Does QE need specific data or tooling to successfully test this epic?

• Nise will need to be updated to give QE advanced data scenarios for testing

Release Criteria

Can this epic be released as individual issues/tasks are completed? Y

Can the backend be released without the frontend? Y

Has QE approved this epic? 

Notes!

• We will only be tackling the trino method for this

https://docs.oracle.com/en-us/iaas/Content/Billing/Tasks/accessingusagereports.htm

More info at - https://docs.google.com/document/d/1feuHYx70MxU1We5_zzKSwZWav0N8PkS4wRaBdl-jSro/edit#