Uploaded image for project: 'Network Observability'
  1. Network Observability
  2. NETOBSERV-980

Flows dropped due to cert issue

XMLWordPrintable

    • False
    • None
    • False
    • NetObserv - Sprint 242, NetObserv - Sprint 243
    • Important

      I've observed flows being dropped due to the following cert issue:

      time=2023-04-12T17:41:25Z level=info component=client error=Post "https://lokistack-gateway-http.netobserv.svc.cluster.local:8080/api/logs/v1/network/loki/api/v1/push": unable to load specified CA cert /var/loki-certs-ca/service-ca.crt: open /var/loki-certs-ca/service-ca.crt: no such file or directory fields.level=warn fields.msg=error sending batch, will retry host=lokistack-gateway-http.netobserv.svc.cluster.local:8080 module=export/loki status=-1

      This periodically affects FLP pods and results in flows being dropped rather than being written to Loki. The problem does seem to self-correct but still is causing us to lose flow data. Attaching a screenshot of this behavior visualized from my most recent PerfScale test.

        1. image-2023-04-12-13-52-16-617.png
          image-2023-04-12-13-52-16-617.png
          34 kB
        2. image-2023-04-18-10-00-54-892.png
          image-2023-04-18-10-00-54-892.png
          36 kB
        3. Screenshot from 2023-06-06 14-36-40.png
          Screenshot from 2023-06-06 14-36-40.png
          56 kB

            rhn-support-sarthoma Sara Thomas
            nweinber1 Nathan Weinberg
            Nathan Weinberg Nathan Weinberg
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved: