Uploaded image for project: 'OpenShift Logging'
  1. OpenShift Logging
  2. LOG-7267

Remap error in output_logging_parse_encoding: join function failed due to non-string array items

XMLWordPrintable

    • Incidents & Support
    • False
    • Hide

      None

      Show
      None
    • False
    • NEW
    • NEW
    • Hide
      Before this update, using a Prune filter to remove Kubernetes metadata fields such as .kubernetes.namespace_name caused a remapping error during Syslog output generation. This prevented the appname and tag fields from being correctly initialized and could stop log forwarding. With this update, improved error handling now initializes these fields with an empty string if the source metadata is missing, which resolves the issue and allows log processing to complete successfully.
      Show
      Before this update, using a Prune filter to remove Kubernetes metadata fields such as .kubernetes.namespace_name caused a remapping error during Syslog output generation. This prevented the appname and tag fields from being correctly initialized and could stop log forwarding. With this update, improved error handling now initializes these fields with an empty string if the source metadata is missing, which resolves the issue and allows log processing to complete successfully.
    • Bug Fix
    • Log Collection - Sprint 273, Logging - Sprint 274

      Description of problem:
      After configuration of an additional ClusterLogForwarder, error messages appear in the collector (Vector) pods indicating a failure during the transform stage: 

      2025-06-03T08:16:37.616017Z ERROR transform{component_kind="transform" component_id=output_logging_abc_parse_encoding component_type=remap}: vector::internal_events::remap: Internal log [Mapping failed with event.] has been suppressed 23 times.
      2025-06-03T08:16:37.616031Z ERROR transform{component_kind="transform" component_id=output_logging_abc_parse_encoding component_type=remap}: vector::internal_events::remap: Mapping failed with event. error="function call error for \"join\" at (352:442): all array items must be strings" error_type="conversion_failed" stage="processing" internal_log_rate_limit=true

      Version-Release number:
      cluster-logging.v6.2.2

       

      How reproducible:
      Install OpenShift Logging v6.2.2 with the default bsclf to internal Loki for applications and infrastructure, and then configure an additional obsclf with a filter to prune logs with a matched label and output to an external syslog server.

      Steps to Reproduce:
      1. Install OpenShift Logging v6.2.2
      2. Configure obsclf to the internal Loki stack.
      3. Configure obsclf to external syslog with applied filters:

      apiVersion: observability.openshift.io/v1
      kind: ClusterLogForwarder
      metadata:
        name: abc-logging
        namespace: openshift-logging
      spec:
        filters:
          - name: filtera
            prune:
              notIn:
                - .message
                - .log_source
                - .log_type
            type: prune
        inputs:
          - application:
              selector:
                matchExpressions:
                  - key: mykey
                    operator: In
                    values:
                      - podnamea
                      - podnameb
                      - podnamec
            name: abclogs
            type: application
        managementState: Managed
        outputs:
          - name: logging-abc
            syslog:
              rfc: RFC5424
              url: 'udp://192.168.0.64:514'
            type: syslog
        pipelines:
          - filterRefs:
              - filtera
            inputRefs:
              - application
              - infrastructure
            name: syslogs-to-abc
            outputRefs:
              - logging-abc
        serviceAccount:
          name: collector

       

      Actual results:
      Collector pods continuously log transformation errors, suggesting a bug in the remap logic triggered by the filter configuration.

      Expected results:
      Transformation should complete without error when processing logs through the configured filter.

      Additional info:
      n/a

        1. vector.toml
          21 kB
          Qiaoling Tang

              vparfono Vitalii Parfonov
              rhn-support-rludva Radomir Ludva
              Qiaoling Tang Qiaoling Tang
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated:
                Resolved: