Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-33285

telemeter-client containers showing TelemeterClientFailures Warnings reporting "gateway server reported unexpected error code: 503:"

XMLWordPrintable

    • No
    • MON Sprint 256, MON Sprint 257, MON Sprint 258, MON Sprint 259, MON Sprint 261
    • 5
    • False
    • Hide

      None

      Show
      None

      Description of problem:

      Cu's reporting TelemeterClientFailures Warnings seen in their multiple clusters. Multiple cases opened in roughly last ~36 hours    

      Version-Release number of selected component (if applicable):

      OCP 4.13.38, OCP 4.12.40     

      How reproducible:

      As per the latest update from one of the CU's:| `After 5 May 18:00 (HKT), this alert resolved by itself on all cluster.
      "gateway error" also not appear after After 5 May 18:00 (HKT)`    

      Steps to Reproduce:

          1.
          2.
          3.
          

      Actual results:

      Telemeter-client container logs report the below errors:
      2024-05-05T06:40:32.162068012Z level=error caller=forwarder.go:276 ts=2024-05-05T06:40:32.161990057Z component=forwarder/worker msg="unable to forward results" err="gateway server reported unexpected error code: 503: <html>\r\n  <head>\r\n    <meta name=\"viewport\" content=\"width=device-width, initial-scale=1\">\r\n\r\n    <style type=\"text/css\">\r\n      body {\r\n        font-family: \"Helvetica Neue\", Helvetica, Arial, sans-serif;\r\n        line-height: 1.66666667;\r\n        font-size: 16px;\r\n        color: #333;\r\n        background-color: #fff;\r\n        margin: 2em 1em;\r\n      }\r\n      h1 {\r\n        font-size: 28px;\r\n        font-weight: 400;\r\n      }\r\n      p {\r\n        margin: 0 0 10px;\r\n      }\r\n      .alert.alert-info {\r\n        background-color: #F0F0F0;\r\n        margin-top: 30px;\r\n        padding: 30px;\r\n      }\r\n      .alert p {\r\n        padding-left: 35px;\r\n      }\r\n      ul {\r\n        padding-left: 51px;\r\n        position: relative;\r\n      }\r\n      li {\r\n        font-size: 14px;\r\n        margin-bottom: 1em;\r\n      }\r\n      p.info {\r\n        position: relative;\r\n        font-size: 20px;\r\n      }\r\n      p.info:before, p.info:after {\r\n        content: \"\";\r\n        left: 0;\r\n        position: absolute;\r\n        top: 0;\r\n      }\r\n"  

      Expected results:

      TelemeterClientFailures alerts should not be seen    

      Additional info:

      What could be the reason behind TelemeterClientFailures alerts firing all of a sudden and likely disappeared after a while ?    

            janantha@redhat.com Jayapriya Pai
            rhn-support-vchalise Vibhuti Chalise
            Junqi Zhao Junqi Zhao
            Simon Pasquier
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

              Created:
              Updated: