Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-31250

alert for metrics endpoint at port 9537 shows connection refused for windows nodes

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done-Errata
    • Icon: Normal Normal
    • None
    • 4.13
    • Monitoring
    • Moderate
    • No
    • MON Sprint 255, MON Sprint 256
    • 2
    • False
    • Hide

      None

      Show
      None
    • Hide
      Previously, connection refused on port 9637 would be shown for windows nodes, this would show as target down in alerts. This is happening CRIO doesn't run in windows nodes. This update fixes the issue by excluding windows nodes in Kubelet Service Monitor
      Show
      Previously, connection refused on port 9637 would be shown for windows nodes, this would show as target down in alerts. This is happening CRIO doesn't run in windows nodes. This update fixes the issue by excluding windows nodes in Kubelet Service Monitor
    • Release Note Not Required
    • In Progress

      Description of problem:

      1. For the Linux nodes, the container runtime is CRI-O and the port 9537 has a crio process listening on it.While, windows nodes doesn't have CRIO container runtime.
      2. Prometheus is trying to connect to /metrics endpoint on the windows nodes on port 9537 which actually does not have any process listening on it. 
      3. TargetDown is alerting crio job since it cannot reach the endpoint http://windows-node-ip:9537/metrics.

      Version-Release number of selected component (if applicable):

      How reproducible:

      Steps to Reproduce:

          1. Install 4.13 cluster with windows operator
    2. In the Prometheus UI, go to > Status > Targets to know which targets are down.  

      Actual results:

          It gives the alert for targetDown

      Expected results:

          It should not give any such alert.

      Additional info:

            janantha@redhat.com Jayapriya Pai
            rh-ee-adpawar Aditya Pawar
            Junqi Zhao Junqi Zhao
            Eliska Romanova Eliska Romanova
            Simon Pasquier
            Votes:
            0 Vote for this issue
            Watchers:
            12 Start watching this issue

              Created:
              Updated:
              Resolved: