Uploaded image for project: 'OpenShift Logging'
  1. OpenShift Logging
  2. LOG-3295

[Vector] Collector pods fail to start with 'error=redefinition of table transforms.multiline_logs' when multiline error detection is enabled

    XMLWordPrintable

Details

    • Bug
    • Resolution: Obsolete
    • Blocker
    • None
    • Logging 5.6.0
    • Log Collection
    • False
    • None
    • False
    • NEW
    • NEW
    • Log Collection - Sprint 227

    Description

      Description of problem:

      When multiline error detection is enabled with Vector as collector and forwarding logs from multiple projects to different log stores, the collector pods fail to start with error:

      $ oc logs collector-xsgck
      Defaulted container "collector" out of: collector, logfilesmetricexporter
      2022-11-16T10:30:17.298209Z  INFO vector::app: Log level is enabled. level="info"
      2022-11-16T10:30:17.298618Z  INFO vector::app: Loading configs. paths=["/etc/vector/vector.toml"]
      2022-11-16T10:30:17.299929Z ERROR vector::cli: Configuration error. error=redefinition of table `transforms.multiline_logs` for key `transforms.multiline_logs` at line 82 column 1 

      Version-Release number of selected component (if applicable):

      cluster-logging.v5.6.0

      elasticsearch-operator.v5.6.0

      Server Version: 4.11.0-0.nightly-2022-11-15-184013

      How reproducible:

      Always

      Steps to Reproduce:

      *Create a ClusterLogforwarder instance to forward logs from multiple projects to different log stores.

      apiVersion: logging.openshift.io/v1
      kind: ClusterLogForwarder
      metadata:
        name: instance
        namespace: openshift-logging
      spec:
        inputs:
        - application:
            namespaces:
            - multi-line-test-1
          name: multi-line-test-1
        - application:
            namespaces:
            - multi-line-test-2
          name: multi-line-test-2
        outputs:
        - name: gcp
          type: googleCloudLogging
          secret:
            name: gcp-secret
          googleCloudLogging:
            projectId : "openshift-qe"
            logId : "aosqe-logging"
        pipelines:
        - detectMultilineErrors: true
          inputRefs:
          - multi-line-test-1
          name: forward-gcp
          outputRefs:
          - gcp
        - detectMultilineErrors: true
          inputRefs:
          - multi-line-test-2
          name: forward-default
          outputRefs:
          - default

      *Check collector pod status and logs.

      ]$ oc get pods
      NAME                                            READY   STATUS             RESTARTS        AGE
      cluster-logging-operator-857476fb59-28f5s       1/1     Running            0               48m
      collector-44ndw                                 1/2     CrashLoopBackOff   6 (4m7s ago)    10m
      collector-9vfx6                                 1/2     CrashLoopBackOff   6 (3m49s ago)   10m
      collector-x5rx8                                 1/2     CrashLoopBackOff   6 (3m57s ago)   10m
      collector-xnx7f                                 1/2     CrashLoopBackOff   6 (3m58s ago)   10m
      collector-xsgck                                 1/2     CrashLoopBackOff   6 (3m54s ago)   10m
      collector-zjkqz                                 1/2     CrashLoopBackOff   6 (3m54s ago)   10m
      elasticsearch-cdm-x5lybzle-1-85847fb656-nctjs   2/2     Running            0               9m54s
      elasticsearch-im-app-27809910-mskvp             0/1     Error              0               9m52s
      elasticsearch-im-audit-27809910-r2xd4           0/1     Error              0               9m52s
      elasticsearch-im-infra-27809910-ljhk4           0/1     Error              0               9m52s
      kibana-5fd868896c-hx7lv                         2/2     Running            0               9m36s
      $ oc logs collector-x5rx8
      Defaulted container "collector" out of: collector, logfilesmetricexporter
      2022-11-16T10:35:55.281539Z  INFO vector::app: Log level is enabled. level="info"
      2022-11-16T10:35:55.281881Z  INFO vector::app: Loading configs. paths=["/etc/vector/vector.toml"]
      2022-11-16T10:35:55.283117Z ERROR vector::cli: Configuration error. error=redefinition of table `transforms.multiline_logs` for key `transforms.multiline_logs` at line 82 column 1 

       

      Attachments

        Activity

          People

            vparfono Vitalii Parfonov
            rhn-support-ikanse Ishwar Kanse
            Ishwar Kanse Ishwar Kanse
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: