Uploaded image for project: 'Observability Documentation'
  1. Observability Documentation
  2. OBSDOCS-212

Collector to act as http server

XMLWordPrintable

    • Icon: Story Story
    • Resolution: Done
    • Icon: Critical Critical
    • None
    • Logging 5.8
    • Logging
    • 3
    • False
    • True
    • OBSDOCS (July 31-Aug 21) #240, OBSDOCS (Aug 21-Sep 11) #241, OBSDOCS (Sep 11 - Oct 2) #242, OBSDOCS (Oct 2 - Oct 23) #243, OBSDOCS (Oct 23 - Nov 13) #244, OBSDOCS (Nov 13 - Dev 4) #245, OBSDOCS (Dec 4 - Dev 25) #246, OBSDOCS (Jan 1 - Jan 22) #247, OBSDOCS (Jan 22 - Feb 12) #248, OBSDOCS (Feb 12 - Mar 4) #249

      Goals

      Collector can be configured to listen for HTTP connections and receive logs as an HTTP server, also referred to as a "webhook"

      Logs from inbound connection can be normalized, filtered and forwarded using existing features of the collector.

      At a minimum must be able to receive logs in the kube-apiserver webhook format, but should be (simply) configurable to receive logs from other popular HTTP protocols and REST APIs (e.g. vector, loki, OTLP etc.)

      Motivation

      Collect logs from Kube-APIserver in hypershift configuration, where the log files are inaccessible so must use the webhook logging option.

      Feeds into a more general requirement for server-side features, begins an extentable "input" framework much like the existing "output" framework.

      Acceptance Criteria

      • Add "source" abstraction to CLF, implement HTTP source.
      • Auto-create a named service for each source
        • Service delegates each incoming connection to an arbitrary collector instance (kube-proxy load-balancing)
        • Kube-apiserver webhook logs received by the collector
        • HTTP input logs can be forwarded in all ways that file-based logs can.

      Documentation Considerations

      Doc for input types will be similar in effort  to documenting output types

            abrennan@redhat.com Ashleigh Brennan
            rkratky@redhat.com Robert Krátký
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

              Created:
              Updated:
              Resolved: