Background

Integrating OpenTelemetry with Splunk allows OpenShift users to export logs, metrics, and traces from the platform and applications to Splunk, where they can be indexed and visualized. This feature will focus on enabling OpenTelemetry collectors to work with Splunk and ensuring that necessary receivers and exporters are supported by the Red Hat build of OpenTelemetry.

High-Level Goals

• Enable integration of OpenTelemetry with Splunk by adding necessary receivers and exporters to the Red Hat build.
• Ensure that OpenShift platform and application telemetry can be collected and forwarded to Splunk using OpenTelemetry collectors.
• Provide configuration and documentation for users to set up the Splunk integration.

Requirements

Splunk Receivers and Exporters

• Identify and configure the receivers and exporters needed for OpenTelemetry collectors to send data to Splunk:
  • Example - Splunk HEC (HTTP Event Collector) exporter: that the splunkhecexporter is included in the Red Hat build of OpenTelemetry to send logs, metrics, and traces to Splunk via its HTTP Event Collector.
• Assess the feasibility of adding the required components to the build, in Tech Preview, ensuring to be clear about the fact that these will not reach GA.
• Ensure proper configuration and testing of the Splunk exporters for compatibility with OpenShift workloads.
• Enable collection and forwarding of logs, traces, and metrics from OpenShift platform and applications to Datadog:

Documentation

• Provide documentation for integrating OpenTelemetry with Splunk, covering:
  • Steps to configure OpenTelemetry collectors with Splunk exporters and receivers.
  • Examples of exporting OpenShift platform metrics, traces, and logs to Datadog.
  • Ensure the documentation highlights any Tech Preview status.

Dashboard Integration (stretch)

• Collaborate with Splunk to create or provide sample dashboards in Splunk that can visualize important OpenShift metrics and traces, such as:
  • Cluster and node health.
  • Application-level performance metrics.
  • Resource utilization and scaling behaviors.
  • Distributed traces of OpenShift workloads, showing dependencies and latencies.
• Explore creating a dashboard that shows the amount of data going to this vendor.