Uploaded image for project: 'Red Hat Developer Hub Bugs'
  1. Red Hat Developer Hub Bugs
  2. RHDHBUGS-666

Consider increasing the startupProbe as it might not be enough on slower clusters

XMLWordPrintable

    • 1
    • False
    • Hide

      None

      Show
      None
    • False
    • Hide
      = Startup probe value might not be enough on slower clusters

      The default value for the container startup probe might not be enough on slower clusters, which may cause the {product-short} container to be in `CrashLoopBackOff` and restart several times.

      As a workaround, you can increase the startup probe failure threshold to 9 in your Helm values file or your Operator default configuration ConfigMap.
      Show
      = Startup probe value might not be enough on slower clusters The default value for the container startup probe might not be enough on slower clusters, which may cause the {product-short} container to be in `CrashLoopBackOff` and restart several times. As a workaround, you can increase the startup probe failure threshold to 9 in your Helm values file or your Operator default configuration ConfigMap.
    • Known Issue
    • Done
    • RHDH Install 3272, RHDH Install 3273, RHDH Install 3274, RHDH Install 3275

      In the case of a freshly created or a slower cluster, the RHDH deployment can take a longer time to start up (the `backstage-backend` pod). This happened specifically with a fresh GKE cluster and an ephemeral spot AKS cluster.

      This can result in exceeding the time that is set in the `startupProbe` that then restarts the pod after the specified time. This can result in `CrashLoopBackOff` for `backstage-backend` pod. 

      The probable solution is to set the probe `failureThreshold: 9` while keeping other values as is. The desired time to start-up can be adjusted with different variables.

      We should increase this for both the Helm chart and the Operator.

      After it is increased in the Helm chart and https://issues.redhat.com/browse/RHIDP-5770 is done, we can remove the probe overrides from:

      • .ibm/pipelines/value_files/values_showcase.yaml
      • .ibm/pipelines/value_files/values_showcase-rbac.yaml

      Related conversation on Slack: https://redhat-internal.slack.com/archives/C06SGFD65NC/p1737451597499919 

              Unassigned Unassigned
              zdrapela@redhat.com Zbynek Drapela
              RHDH Install
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: