Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-63708

The kube-rbac-proxy container in openshift-monitoring pods report TLS handshake error

XMLWordPrintable

    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • None
    • Moderate
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Steps to Reproduce:
          1. Deploy openshift 4.17.z , 4.18.z , 4.19.z , 4.20 cluster
          2. Enable monitoring for user-defined projects
          3. check logs in the kube-rbac-proxy container in openshift-monitoring and kube-rbac-proxy-fedrate in openshift-user-workload-monitoring     

      Actual results:

      $ oc logs pod/prometheus-k8s-1 -n openshift-monitoring -c kube-rbac-proxy-web
      2025-10-10T14:05:22.967819891Z I1010 14:05:22.967765       1 log.go:245] http: TLS handshake error from 10.x.x.x:45506: write tcp 10.x.x.x:9091->10.x.x.x:45506
      : write: connection reset by peer
      2025-10-10T14:05:27.814475368Z I1010 14:05:27.814432       1 log.go:245] http: TLS handshake error from 10.x.x.x:37496: write tcp 10.x.x.x:9091->10.x.x.x:37496
      : write: connection reset by peer
      2025-10-10T14:05:27.972285073Z I1010 14:05:27.972250       1 log.go:245] http: TLS handshake error from 10.x.x.x:37502: write tcp 10.x.x.x:9091->10.x.x.x:37502
      : write: connection reset by peer
      $ oc logs pod/alertmanager-main-0 -n openshift-monitoring -c kube-rbac-proxy-web
      
      2025-10-11T19:58:55.338233491Z I1011 19:58:55.338186       1 log.go:245] http: TLS handshake error from 10.x.x.x:57750: write tcp 10.x.x.x:9091->10.x.x.x:57750: write: connection reset by peer
      2025-10-11T19:59:05.352256440Z I1011 19:59:05.352203       1 log.go:245] http: TLS handshake error from 10.x.x.x:53638: write tcp 10.x.x.x:9091->10.x.x.x:53638: write: connection reset by peer
      2025-10-11T19:59:05.440605134Z I1011 19:59:05.440552       1 log.go:245] http: TLS handshake error from 10.x.x.x:58552: write tcp 10.x.x.x:9091->10.x.x.x:58552: write: connection reset by peer
      
      $ oc logs pod/thanos-querier-6748b775c4-97xq2 -n openshift-monitoring -c kube-rbac-proxy-web
      
      2025-10-11T13:17:01.692842669Z I1011 13:17:01.692638       1 log.go:245] http: TLS handshake error from 10.x.x.x:41140: write tcp 10.x.x.x:9095->10.x.x.x:41140
      : write: connection reset by peer
      2025-10-11T13:17:06.525945179Z I1011 13:17:06.525754       1 log.go:245] http: TLS handshake error from 10.x.x.x:50954: write tcp 10.x.x.x:9095->10.x.x.x:50954
      : write: connection reset by peer
      2025-10-11T13:17:11.534553867Z I1011 13:17:11.534365       1 log.go:245] http: TLS handshake error from 10.x.x.x:50964: write tcp 10.x.x.x:9095->10.x.x.x:50964
      : write: connection reset by peer
      
      $ oc logs prometheus-user-workload-0 -n openshift-user-workload-monitoring -c kube-rbac-proxy-federate
      
      2025-10-14T18:30:51.276015945Z I1014 18:30:51.275922       1 log.go:245] http: TLS handshake error from 10.x.x.x:35348: write tcp 10.x.x.x:9092->10.x.x.x:3534
      8: write: connection reset by peer
      2025-10-14T18:30:55.016835426Z I1014 18:30:55.016758       1 log.go:245] http: TLS handshake error from 10.x.x.x:40536: write tcp 10.x.x.x:9092->10.x.x.x:4053
      6: write: connection reset by peer
      2025-10-14T18:30:56.282826448Z I1014 18:30:56.282753       1 log.go:245] http: TLS handshake error from 10.x.x.x:37502: write tcp 10.x.x.x:9092->10.x.x.x:3750
      2: write: connection reset by peer
      
      Expected results : No TLS handshake error

              Unassigned Unassigned
              rhn-support-bborole Bhuvanesh Borole
              None
              None
              Xingxing Xia Xingxing Xia
              None
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: