Uploaded image for project: 'OpenShift Logging'
  1. OpenShift Logging
  2. LOG-6807

Using OTLP transforms has not consumers

XMLWordPrintable

    • Future Sustainability
    • False
    • Hide

      None

      Show
      None
    • False
    • NEW
    • Release Notes
    • NEW
    • Hide
      Before this change the operator generated configuration that did not account for unmatched log events which produced a warning message when the collector started. This change removes the warning by accounting for these log events and producing an error alert if unmatched messages are detected.
      Show
      Before this change the operator generated configuration that did not account for unmatched log events which produced a warning message when the collector started. This change removes the warning by accounting for these log events and producing an error alert if unmatched messages are detected.
    • Bug Fix
    • Logging - Sprint 278
    • Low

      Description of problem:

      When it's configured Logging v6.2 for log forwarding to Loki v6.2 using OTLP as documented [0], it's observed in the collector logs a warning where the outputs are not consumed like below:

      $ oc logs collector-g22bc 
      Creating the directory used for persisting Vector state /var/lib/vector/openshift-logging/collector
      Starting Vector process...
      2025-03-03T16:31:26.841958Z  WARN vector::config::loading: Transform "output_loki_otlp_application_reroute._unmatched" has no consumers
      2025-03-03T16:31:26.842014Z  WARN vector::config::loading: Transform "output_loki_otlp_audit_reroute._unmatched" has no consumers
      2025-03-03T16:31:26.842019Z  WARN vector::config::loading: Transform "output_loki_otlp_infrastructure_reroute._unmatched" has no consumers
      

      Version-Release number of selected component (if applicable):

      $ oc get csv -n openshift-logging|grep "logging"
      cluster-logging.v6.2.0                  Red Hat OpenShift Logging                        6.2.0      cluster-logging.v6.1.2           Succeeded
      

      How reproducible:

      Always

      Steps to Reproduce:

      1. Deploy CLO v6.2 and Loki v6.2 and configure Loki with schema version v13
      2. Create a clusterLogForwarder custom resource with the next yaml:
        apiVersion: observability.openshift.io/v1
        kind: ClusterLogForwarder
        metadata:
          name: collector
          namespace: openshift-logging
          annotations:
            observability.openshift.io/tech-preview-otlp-output: "enabled" 
        spec:
          serviceAccount:
            name: collector
          outputs:
          - name: loki-otlp
            type: lokiStack 
            lokiStack:
              target:
                name: logging-loki
                namespace: openshift-logging
              dataModel: Otel 
              authentication:
                token:
                  from: serviceAccount
            tls:
              ca:
                key: service-ca.crt
                configMapName: openshift-service-ca.crt
          pipelines:
          - name: my-pipeline
            inputRefs:
            - application
            - infrastructure
            outputRefs:
            - loki-otlp
        

      Actual results:

      Logs are observed in the OpenShift UI Console

      All the collector pods throw in the logs the WARN message:

      $ oc logs collector-g22bc 
      Creating the directory used for persisting Vector state /var/lib/vector/openshift-logging/collector
      Starting Vector process...
      2025-03-03T16:31:26.841958Z  WARN vector::config::loading: Transform "output_loki_otlp_application_reroute._unmatched" has no consumers
      2025-03-03T16:31:26.842014Z  WARN vector::config::loading: Transform "output_loki_otlp_audit_reroute._unmatched" has no consumers
      2025-03-03T16:31:26.842019Z  WARN vector::config::loading: Transform "output_loki_otlp_infrastructure_reroute._unmatched" has no consumers
      

      Expected results:

      Not expected to see any WARN related to the transforms created and not consumed

      [0] https://docs.openshift.com/container-platform/4.17/observability/logging/logging-6.1/log6x-about-6.1.html#quick-start-opentelemetry_

      {context}

          There are no Sub-Tasks for this issue.

              jcantril@redhat.com Jeffrey Cantrill
              rhn-support-ocasalsa Oscar Casal Sanchez
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: