Uploaded image for project: 'Hybrid Cloud Console'
  1. Hybrid Cloud Console
  2. RHCLOUD-28890

Introduce auto-scaling for notifications-engine

XMLWordPrintable

      Update clowdapp tempate and add one condition based on kafka lag metrics (determine if pods # need to increase)

       

      Testing: create kafka lag and see # of kafka pods increases bc of lag. Then # of pod decreases when lag is gone

            [RHCLOUD-28890] Introduce auto-scaling for notifications-engine

            Jessica Rodriguez added a comment - - edited

            Flag added

            The autoscaler currently appears to work as configured in the draft PR, but Clowder overrides any changes it attempts to make. Awaiting a fix/workaround from eng-prod to continue testing in stage (see blocker issues).

            Jessica Rodriguez added a comment - - edited Flag added The autoscaler currently appears to work as configured in the draft PR, but Clowder overrides any changes it attempts to make. Awaiting a fix/workaround from eng-prod to continue testing in stage (see blocker issues).

            GitLab CEE Bot added a comment -

            Jessica Rodriguez mentioned this issue in merge request !118465 of Service Delivery / app-interface on branch RHCLOUD-28890:

            RHCLOUD-28890 Enable autoscaler in insights-ephemeral prometheus pool

            GitLab CEE Bot added a comment - Jessica Rodriguez mentioned this issue in merge request !118465 of Service Delivery / app-interface on branch RHCLOUD-28890 : RHCLOUD-28890 Enable autoscaler in insights-ephemeral prometheus pool

            GitLab CEE Bot added a comment -

            Jessica Rodriguez mentioned this issue in merge request !117898 of Service Delivery / app-interface on branch RHCLOUD-28890:

            RHCLOUD-28890 Add ScaledObject managedResourceType for Notifications

            GitLab CEE Bot added a comment - Jessica Rodriguez mentioned this issue in merge request !117898 of Service Delivery / app-interface on branch RHCLOUD-28890 : RHCLOUD-28890 Add ScaledObject managedResourceType for Notifications

            Jessica Rodriguez added a comment -

            Waiting for some issues with KedaResources to get resolved on the operator side

            Jessica Rodriguez added a comment - Waiting for some issues with KedaResources to get resolved on the operator side

            Gwenneg Lepage added a comment -

            https://consoledot.pages.redhat.com/clowder/dev/api_reference.html#k8s-api-github-com-redhatinsights-clowder-apis-cloud-redhat-com-v1alpha1-autoscaler

            https://www.redhat.com/en/blog/custom-metrics-autoscaler-on-openshift

            Gwenneg Lepage added a comment - https://consoledot.pages.redhat.com/clowder/dev/api_reference.html#k8s-api-github-com-redhatinsights-clowder-apis-cloud-redhat-com-v1alpha1-autoscaler https://www.redhat.com/en/blog/custom-metrics-autoscaler-on-openshift

            Katie Riedesel added a comment -

            glepage@redhat.com did you get a chance to review? thanks!

            -kriedese 

            Katie Riedesel added a comment - glepage@redhat.com did you get a chance to review? thanks! - kriedese  

            Greg McCullough added a comment -

            glepage@redhat.com Please update ticket with the latest information.

            Greg McCullough added a comment - glepage@redhat.com Please update ticket with the latest information.

            Katie Riedesel added a comment -

            gburges@redhat.com psavage@redhat.com me again

             

            Thanks!

            -kriedese 

            Katie Riedesel added a comment - gburges@redhat.com psavage@redhat.com me again   Thanks! - kriedese  

            Katie Riedesel added a comment -

            gburges@redhat.com remind me the status here? THANK YOU!

            -kriedese 

            Katie Riedesel added a comment - gburges@redhat.com remind me the status here? THANK YOU! - kriedese  

            Gabor Burges added a comment -

            CMA is installed in CRCD, EPHemeral, and Stage clusters, going to talk with psavage@redhat.com about turning it on

             

            Gabor Burges added a comment - CMA is installed in CRCD, EPHemeral, and Stage clusters, going to talk with psavage@redhat.com about turning it on  

            Katie Riedesel added a comment -

            gburges@redhat.com mind updating!

            Katie Riedesel added a comment - gburges@redhat.com mind updating!

            Katie Riedesel added a comment -

            gburges@redhat.com did you ever hear back on your follow-up last week?

             

            Thanks!

            -kriedese 

            Katie Riedesel added a comment - gburges@redhat.com did you ever hear back on your follow-up last week?   Thanks! - kriedese  

            Katie Riedesel added a comment -

            Checking status- https://redhat-internal.slack.com/archives/C01UC7NRV19/p1707925469001349

            Katie Riedesel added a comment - Checking status- https://redhat-internal.slack.com/archives/C01UC7NRV19/p1707925469001349

            Katie Riedesel added a comment -

            kriedese follow up devprod

            Katie Riedesel added a comment - kriedese follow up devprod

            Katie Riedesel added a comment -

            Hi! 

             

            as soon as app-sre supports custom metrics autoscaler, we can enable it in clowder

             

            https://issues.redhat.com/browse/RHCLOUD-25394

            Katie Riedesel added a comment - Hi!    as soon as app-sre supports custom metrics autoscaler, we can enable it in clowder   https://issues.redhat.com/browse/RHCLOUD-25394

            Petr Blaho (Inactive) added a comment -

            glepage@redhat.com psavage@redhat.com gburges@redhat.com  where is this clowder ticket tracked? The one that would allow apps to scale up and down when metrics change (kafka backlog for drift) - I would like to follow that.

            Petr Blaho (Inactive) added a comment - glepage@redhat.com psavage@redhat.com gburges@redhat.com   where is this clowder ticket tracked? The one that would allow apps to scale up and down when metrics change (kafka backlog for drift) - I would like to follow that.

            Gwenneg Lepage added a comment -

            Thanks for checking, we need this in Q4.

            Gwenneg Lepage added a comment - Thanks for checking, we need this in Q4.

            Katie Riedesel added a comment -

            glepage@redhat.com forgot to ask in grooming today. Would we want to include this as part of our Q4 deliverable for OCM or would this be something to tackle in Q1?

             

            Thanks!

            -kriedese 

            cc: rhn-support-jhatcher 

            Katie Riedesel added a comment - glepage@redhat.com forgot to ask in grooming today. Would we want to include this as part of our Q4 deliverable for OCM or would this be something to tackle in Q1?   Thanks! - kriedese   cc: rhn-support-jhatcher  

            Katie Riedesel added a comment -

            kriedese link to OCM epic

             

            glepage@redhat.com to edit details

            Katie Riedesel added a comment - kriedese link to OCM epic   glepage@redhat.com to edit details

              rh-ee-jrodri Jessica Rodriguez
              glepage@redhat.com Gwenneg Lepage
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

                Created:
                Updated: