-
Story
-
Resolution: Done
-
Undefined
-
None
-
None
It could be interesting to define the pipeline stages and order via a configuration file (e.g. to be able to split our component in multiple sub-components running in different services, if there are scalability reasons for it). This task consists on:
- Investigate existing DSLs for defining data pipelines versus creating our own, simpler YAML format for defining the stages and the order. Another possibility is to adopt and extend the current flowlogs2metrics format. E.g.: https://github.com/netobserv/flowlogs2metrics/blob/main/network_definitions/bandwidth_per_src_subnet.yaml
- Investigate if is worth to define the different stages of the pipeline as Go modules, so we can load them dynamically when parsing the definition files from the previous bullet. We need to consider Go modules' limitations.
- is blocked by
-
NETOBSERV-184 Split and Integrate flowlogs2metrics in kube-enricher
-
- Closed
-