Uploaded image for project: 'OpenShift Logging'
  1. OpenShift Logging
  2. LOG-4008

[release-5.6] Failed to create memberlist no private IP address found

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Major Major
    • Logging 5.6.5
    • Logging 5.5.7, Logging 5.6.2, Logging 5.7.0
    • Log Storage
    • False
    • None
    • False
    • NEW
    • VERIFIED
    • Hide
      Before this update, the Loki Operator did not produce a memberlist configuration sufficient for finding all the components when a memberlist for private IP networks was used. With this update, the generated configuration correctly contains the advertised port, so that the lookup is successful.
      Show
      Before this update, the Loki Operator did not produce a memberlist configuration sufficient for finding all the components when a memberlist for private IP networks was used. With this update, the generated configuration correctly contains the advertised port, so that the lookup is successful.

      Description of problem:

      On OpenShift clusters where the administrators choose to use non-private networks (RFC 1918 and RFC 6598) for the cluster pod network, it is not possible to deploy LokiStack cluster. Due to the default assignment in the hash ring configuration to advertise IP address from private IP networks only, the ingester, distributor and querier component are able to form a healthy gossip ring.

      Version-Release number of selected component (if applicable):

      OpenShift Logging 5.5

      OpenShift Logging 5.6

      How reproducible:

      Always

      Steps to Reproduce:

      1.  
      2.  
      3. ...

      Actual results:

      1. Crashlooping pods:
      logging-loki-compactor-0                      0/1     CrashLoopBackOff   
      logging-loki-distributor-74f676459-9gbzh      0/1     CrashLoopBackOff   
      logging-loki-distributor-74f676459-zlqhj      0/1     CrashLoopBackOff   
      logging-loki-ingester-0                       0/1     CrashLoopBackOff   
      logging-loki-querier-6d56f558b-rnflv          0/1     CrashLoopBackOff   
      logging-loki-querier-6d56f558b-z7h8f          0/1     CrashLoopBackOff
      1. Services from pods has no endpoints.
      2. Error message:
      failed to create memberlist: Failed to get final advertise address: no private IP address found, and explicit IP not provided 

      Expected results:

      All LokiStack pods required to form a health hash ring advertise IP address from the pod network range. In turn all pods are healthy and normal operations resume.

      Additional info:

      KCS: failed to create memberlist no private IP address found" in Loki for OCP 4

              ptsiraki@redhat.com Periklis Tsirakidis
              ptsiraki@redhat.com Periklis Tsirakidis
              Qiaoling Tang Qiaoling Tang
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: