AS A OCP engineer
I WANT to mix my specific data with CCX data
TO do reporting I need for my work

Goal
Enable others to easily process data and store in their isolated bucket in one day.

We want to achieve this by providing easy to replicate pipeline template and docs to setup and populate own Trino schema.

Context
Hosting pipeline creates huge maintenance burden not only for maintaining the pipeline and logic in there but also the data ownership, service accounts, handling external sources failures, data access management.

We also can't mix IO data with data from other sources. We need to keep separate access permissions to not bypass security setup on the data sources.

By enabling others to setup own pipeline we can let them to have the responsibility for their schema and data quality.