Uploaded image for project: 'OpenShift Logging'
  1. OpenShift Logging
  2. LOG-1157

Implement the JSON forwarding proposal

    XMLWordPrintable

Details

    • Task
    • Resolution: Done
    • Critical
    • Logging 5.1
    • None
    • Log Collection
    • None
    • 5
    • False
    • False
    • NEW
    • NEW
    • Undefined
    • Logging (Core) - Sprint 198

    Description

      Summary

      Implement the JSON forwarding proposal

      Acceptance Criteria

      • Transformed records include additional top-level fields
      • The schema field is optional
      • Structured JSON container and journal records are parsable
      • Legacy managed ES continues to utilize "flat_labels" with no structured messages
      • The 'structured' field is populated as a map for JSON messages and 'message' field is unpopulated
      • The 'message' field is populated as-is string for non-JSON messages and the 'structure' field is unpopulated

      Notes

      • Additional acceptance criteria can be determined from the proposal

       

      Attachments

        Issue Links

          is related to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. LOG-1148 Stop mangling JSON records for non-elasticsearch outputs

          • Critical - To be worked on immediately following BLOCKER issues.
          • Closed

          Task - Represents a small unit of work that is not end-user facing. LOG-1099 Add JSON pipeline to Elasticsearch

          • Major - To be worked after higher priority work items are addressed. When the severity is high and the effort to change it is low to moderate, this term is chosen. Issues in this category likely have an existing workaround but implementation or execution may be non-trivial.
          • Closed

          Task - Represents a small unit of work that is not end-user facing. LOG-1153 Create rollover/delete policies for json indices

          • Normal - To be worked after urgent and high priorities are resolved. This term is chosen when the severity of an issue is relatively close to the level of effort to fix it. The existence of an easily implemented workaround can also lead to this priority level instead of a higher priority.
          • Closed
          relates to

          Bug - A problem that impairs or prevents the functions of the product. LOG-1355 No default output configuration in Clusterlogforwarders.logging.openshift.io

          • Critical - To be worked on immediately following BLOCKER issues.
          • Closed

          Task - Represents a small unit of work that is not end-user facing. LOG-2011 Support Json Forwarding feature

          • Undefined - Priority not specified.
          • Closed
          links to

          GitHub openshift/cluster-logging-operator#932: Add initial json format test for LOG-1157

          GitHub openshift/cluster-logging-operator#934: WIP: LOG-1157: Implement Json Forwarding

          GitHub openshift/cluster-logging-operator#961: LOG-1157: Send Logs to specific ES index

          GitHub openshift/origin-aggregated-logging#2082: LOG-1157: Added Oj parser for json parsing

          Activity

            People

              vimalkum@redhat.com Vimal Kumar
              rhn-engineering-aconway Alan Conway
              Giriyamma Karagere Ramaswamy Giriyamma Karagere Ramaswamy (Inactive)
              Votes:
              2 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: