Uploaded image for project: 'OpenShift Logging'
  1. OpenShift Logging
  2. LOG-3814

[release-5.6] Failed to create memberlist no private IP address found

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Major Major
    • Logging 5.6.4
    • Logging 5.5.7, Logging 5.6.2, Logging 5.7.0
    • Log Storage
    • False
    • None
    • False
    • NEW
    • VERIFIED
    • Hide
      Before this update, the static LokiStack memberlist configuration using only private IP networks caused the LokiStack pods to crashloop under the condition that the OCP cluster pod network is using a non-private IP network range. With this update, the LokiStack administrator can select to use the pod network for the memberlist configuration and resolves the issue.
      Show
      Before this update, the static LokiStack memberlist configuration using only private IP networks caused the LokiStack pods to crashloop under the condition that the OCP cluster pod network is using a non-private IP network range. With this update, the LokiStack administrator can select to use the pod network for the memberlist configuration and resolves the issue.
    • Log Storage - Sprint 233, Log Storage - Sprint 234

      Description of problem:

      On OpenShift clusters where the administrators choose to use non-private networks (RFC 1918 and RFC 6598) for the cluster pod network, it is not possible to deploy LokiStack cluster. Due to the default assignment in the hash ring configuration to advertise IP address from private IP networks only, the ingester, distributor and querier component are able to form a healthy gossip ring.

      Version-Release number of selected component (if applicable):

      OpenShift Logging 5.5

      OpenShift Logging 5.6

      How reproducible:

      Always

      Steps to Reproduce:

      1.  
      2.  
      3. ...

      Actual results:

      1. Crashlooping pods:
      logging-loki-compactor-0                      0/1     CrashLoopBackOff   
      logging-loki-distributor-74f676459-9gbzh      0/1     CrashLoopBackOff   
      logging-loki-distributor-74f676459-zlqhj      0/1     CrashLoopBackOff   
      logging-loki-ingester-0                       0/1     CrashLoopBackOff   
      logging-loki-querier-6d56f558b-rnflv          0/1     CrashLoopBackOff   
      logging-loki-querier-6d56f558b-z7h8f          0/1     CrashLoopBackOff
      1. Services from pods has no endpoints.
      2. Error message:
      failed to create memberlist: Failed to get final advertise address: no private IP address found, and explicit IP not provided 

      Expected results:

      All LokiStack pods required to form a health hash ring advertise IP address from the pod network range. In turn all pods are healthy and normal operations resume.

      Additional info:

      KCS: failed to create memberlist no private IP address found" in Loki for OCP 4

              ptsiraki@redhat.com Periklis Tsirakidis
              ptsiraki@redhat.com Periklis Tsirakidis
              Qiaoling Tang Qiaoling Tang
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated:
                Resolved: