Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-69396

After disabling local AlertMananager, there are still AlertManager alerts, and AlertManager related DNS queries to the insights operator

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Normal Normal
    • None
    • 4.16, 4.17, 4.18, 4.19, 4.20
    • Insights Operator
    • None
    • None
    • False
    • Hide

      None

      Show
      None
    • None
    • Important
    • None
    • All
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Description of problem:

      After disabling the local AlertManager as described in the documentation (https://docs.redhat.com/en/documentation/openshift_container_platform/4.18/html/monitoring/configuring-core-platform-monitoring), the PrometheusNotConnectedToAlertmanagers alert fires in the cluster and there are still DNS requests failing like this one: 
       alertmanager-main.openshift-monitoring.svc.openshift-insights.svc.cluster.local alertmanager-main.openshift-monitoring.svc.svc.cluster.local 
      
       It seems that insights still have some AlertManager stuff in the configuration.     
      
      oc logs -n openshift-insights insights-operator-7ccd69f68c-frnvf | grep alertmanager
      Recording config/pdbs/openshift-monitoring/alertmanager-main
      alert "AlertmanagerReceiversNotConfigured" has state "pending"

       

      Version-Release number of selected component (if applicable):

      4.16 - 4.20    

      How reproducible:

      100%

      Steps to Reproduce:

         1. Disable AlertManager
          2. Check that the PrometheusNotConnectedToAlertmanagers
          3. Enable trace or debug Level in dns-pods
          4. Check dns pod logs. There will be request like this: 
      alertmanager-main.openshift-monitoring.svc.openshift-insights.svc.cluster.local
      alertmanager-main.openshift-monitoring.svc.svc.cluster.local     

      Actual results:

      The PrometheusNotConnectedToAlertmanagers alert fires. 
      There will be DNS request failing.

      Expected results:

      When disabling AlertManager, there should not be AlertManager DNS requests or alerts.

      Additional info:

          

              rh-ee-ijimeno Isaac Jimeno
              rhn-support-mangarci Manrique García
              None
              None
              Baiyang Zhou Baiyang Zhou
              None
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: