Loading...

Type: Bug
Resolution: Unresolved
Priority: Major
Fix Version/s: None
Affects Version/s: 2.16.0 GA, 2.15.3 GA
Component/s: 3scale Operator
Labels:
None

Blocked:
False
Blocked Reason:

Hide

None

Show
None
Ready:
False
3Scale PT Tested upstream:
Not Started
3scale PT Docs:
Not Started
3scale PT Product Specs:
Not Started
3scale PT Product Update Ready:
Not Started
3scale PT Released In Saas:
Not Started
3scale PT Verified Product:
Not Started
Intelligence Requested:
Market:

SFDC Cases Counter:
SFDC Cases Open:
SFDC Cases Links:

When monitoring is enabled, all objects necessary are created: PodMonitor, PrometheusRule, GrafanaDashboard.

When monitoring is disabled (e.g. by patch) all objects are deleted except GrafanaDashboards.

Expected behaviour is to delete all monitoring related objects that were created by operator.

This bug is present in 2.15 and 2.16/alpha, it is not present in 2.14.

attaching log when monitoring is enabled:

{"level":"info","ts":"2025-05-09T09:11:05Z","logger":"controllers.APIManager","msg":"ReconcileAPIManager","apimanager":{"name":"3scale-aws","namespace":"3scale-ga"},"Operator version":"0.12.3","3scale release":"2.15"}
{"level":"info","ts":"2025-05-09T09:11:05Z","logger":"controllers.APIManager","msg":"Updated object 'v1.Deployment/backend-cron'"}
{"level":"info","ts":"2025-05-09T09:11:05Z","logger":"controllers.APIManager","msg":"Updated object 'v1.Deployment/backend-listener'"}
{"level":"info","ts":"2025-05-09T09:11:05Z","logger":"controllers.APIManager","msg":"Created object 'v1.PodMonitor/backend-worker'"}
{"level":"info","ts":"2025-05-09T09:11:05Z","logger":"controllers.APIManager","msg":"Created object 'v1.PodMonitor/backend-listener'"}
{"level":"info","ts":"2025-05-09T09:11:05Z","logger":"controllers.APIManager","msg":"Created object 'v1beta1.GrafanaDashboard/backend'"}
{"level":"info","ts":"2025-05-09T09:11:06Z","logger":"controllers.APIManager","msg":"Created object 'v1.PrometheusRule/backend-worker'"}
{"level":"info","ts":"2025-05-09T09:11:06Z","logger":"controllers.APIManager","msg":"Created object 'v1.PrometheusRule/backend-listener'"}
{"level":"info","ts":"2025-05-09T09:11:06Z","logger":"controllers.APIManager","msg":"Delete object 'v2.HorizontalPodAutoscaler/backend-listener'"}
{"level":"info","ts":"2025-05-09T09:11:06Z","logger":"controllers.APIManager","msg":"Delete object 'v2.HorizontalPodAutoscaler/backend-worker'"}
{"level":"info","ts":"2025-05-09T09:11:06Z","logger":"controllers.APIManager","msg":"Updated object 'v1.Deployment/system-searchd'"}
{"level":"info","ts":"2025-05-09T09:11:06Z","logger":"controllers.APIManager","msg":"Created object 'v1.PodMonitor/system-sidekiq'"}
{"level":"info","ts":"2025-05-09T09:11:06Z","logger":"controllers.APIManager","msg":"Created object 'v1.PodMonitor/system-app'"}
{"level":"info","ts":"2025-05-09T09:11:06Z","logger":"controllers.APIManager","msg":"Created object 'v1beta1.GrafanaDashboard/system'"}
{"level":"info","ts":"2025-05-09T09:11:06Z","logger":"controllers.APIManager","msg":"Created object 'v1.PrometheusRule/system-app'"}
{"level":"info","ts":"2025-05-09T09:11:06Z","logger":"controllers.APIManager","msg":"Created object 'v1.PrometheusRule/system-sidekiq'"}
{"level":"info","ts":"2025-05-09T09:11:06Z","logger":"controllers.APIManager","msg":"Created object 'v1.PodMonitor/zync'"}
{"level":"info","ts":"2025-05-09T09:11:06Z","logger":"controllers.APIManager","msg":"Created object 'v1.PodMonitor/zync-que'"}
{"level":"info","ts":"2025-05-09T09:11:06Z","logger":"controllers.APIManager","msg":"Created object 'v1beta1.GrafanaDashboard/zync'"}
{"level":"info","ts":"2025-05-09T09:11:07Z","logger":"controllers.APIManager","msg":"Created object 'v1.PrometheusRule/zync'"}
{"level":"info","ts":"2025-05-09T09:11:07Z","logger":"controllers.APIManager","msg":"Created object 'v1.PrometheusRule/zync-que'"}
{"level":"info","ts":"2025-05-09T09:11:07Z","logger":"controllers.APIManager","msg":"Created object 'v1beta1.GrafanaDashboard/apicast-mainapp'"}
{"level":"info","ts":"2025-05-09T09:11:07Z","logger":"controllers.APIManager","msg":"Created object 'v1beta1.GrafanaDashboard/apicast-services'"}
{"level":"info","ts":"2025-05-09T09:11:07Z","logger":"controllers.APIManager","msg":"Created object 'v1.PrometheusRule/apicast'"}
{"level":"info","ts":"2025-05-09T09:11:07Z","logger":"controllers.APIManager","msg":"Created object 'v1.PodMonitor/apicast-production'"}
{"level":"info","ts":"2025-05-09T09:11:07Z","logger":"controllers.APIManager","msg":"Created object 'v1.PodMonitor/apicast-staging'"}
{"level":"info","ts":"2025-05-09T09:11:07Z","logger":"controllers.APIManager","msg":"Delete object 'v2.HorizontalPodAutoscaler/apicast-production'"}
{"level":"info","ts":"2025-05-09T09:11:07Z","logger":"controllers.APIManager","msg":"Created object 'v1beta1.GrafanaDashboard/kubernetes-resources-by-namespace'"}
{"level":"info","ts":"2025-05-09T09:11:07Z","logger":"controllers.APIManager","msg":"Created object 'v1beta1.GrafanaDashboard/kubernetes-resources-by-pod'"}
{"level":"info","ts":"2025-05-09T09:11:07Z","logger":"controllers.APIManager","msg":"Created object 'v1.PrometheusRule/threescale-kube-state-metrics'"}
{"level":"info","ts":"2025-05-09T09:11:07Z","logger":"olm","msg":"Found deployments with status ","stopped":[],"starting":[],"ready":["apicast-production","apicast-staging","backend-cron","backend-listener","backend-redis","backend-worker","system-app","system-memcache","system-mysql","system-redis","system-searchd","system-sidekiq","zync","zync-database","zync-que"]}

and when monitoring is disabled:

{"level":"info","ts":"2025-05-09T09:11:17Z","logger":"controllers.APIManager","msg":"ReconcileAPIManager","apimanager":{"name":"3scale-aws","namespace":"3scale-ga"},"Operator version":"0.12.3","3scale release":"2.15"}
{"level":"info","ts":"2025-05-09T09:11:17Z","logger":"controllers.APIManager","msg":"Updated object 'v1.Deployment/backend-cron'"}
{"level":"info","ts":"2025-05-09T09:11:17Z","logger":"controllers.APIManager","msg":"Updated object 'v1.Deployment/backend-listener'"}
{"level":"info","ts":"2025-05-09T09:11:17Z","logger":"controllers.APIManager","msg":"Delete object 'v1.PodMonitor/backend-worker'"}
{"level":"info","ts":"2025-05-09T09:11:17Z","logger":"controllers.APIManager","msg":"Delete object 'v1.PodMonitor/backend-listener'"}
{"level":"info","ts":"2025-05-09T09:11:17Z","logger":"controllers.APIManager","msg":"Delete object 'v1.PrometheusRule/backend-worker'"}
{"level":"info","ts":"2025-05-09T09:11:17Z","logger":"controllers.APIManager","msg":"Delete object 'v1.PrometheusRule/backend-listener'"}
{"level":"info","ts":"2025-05-09T09:11:17Z","logger":"controllers.APIManager","msg":"Delete object 'v2.HorizontalPodAutoscaler/backend-listener'"}
{"level":"info","ts":"2025-05-09T09:11:17Z","logger":"controllers.APIManager","msg":"Delete object 'v2.HorizontalPodAutoscaler/backend-worker'"}
{"level":"info","ts":"2025-05-09T09:11:17Z","logger":"controllers.APIManager","msg":"Updated object 'v1.Deployment/system-searchd'"}
{"level":"info","ts":"2025-05-09T09:11:17Z","logger":"controllers.APIManager","msg":"Delete object 'v1.PodMonitor/system-sidekiq'"}
{"level":"info","ts":"2025-05-09T09:11:17Z","logger":"controllers.APIManager","msg":"Delete object 'v1.PodMonitor/system-app'"}
{"level":"info","ts":"2025-05-09T09:11:17Z","logger":"controllers.APIManager","msg":"Delete object 'v1.PrometheusRule/system-app'"}
{"level":"info","ts":"2025-05-09T09:11:17Z","logger":"controllers.APIManager","msg":"Delete object 'v1.PrometheusRule/system-sidekiq'"}
{"level":"info","ts":"2025-05-09T09:11:17Z","logger":"controllers.APIManager","msg":"Delete object 'v1.PodMonitor/zync'"}
{"level":"info","ts":"2025-05-09T09:11:17Z","logger":"controllers.APIManager","msg":"Delete object 'v1.PodMonitor/zync-que'"}
{"level":"info","ts":"2025-05-09T09:11:18Z","logger":"controllers.APIManager","msg":"Delete object 'v1.PrometheusRule/zync'"}
{"level":"info","ts":"2025-05-09T09:11:18Z","logger":"controllers.APIManager","msg":"Delete object 'v1.PrometheusRule/zync-que'"}
{"level":"info","ts":"2025-05-09T09:11:18Z","logger":"controllers.APIManager","msg":"Delete object 'v1.PrometheusRule/apicast'"}
{"level":"info","ts":"2025-05-09T09:11:18Z","logger":"controllers.APIManager","msg":"Delete object 'v1.PodMonitor/apicast-production'"}
{"level":"info","ts":"2025-05-09T09:11:18Z","logger":"controllers.APIManager","msg":"Delete object 'v1.PodMonitor/apicast-staging'"}
{"level":"info","ts":"2025-05-09T09:11:18Z","logger":"controllers.APIManager","msg":"Delete object 'v2.HorizontalPodAutoscaler/apicast-production'"}
{"level":"info","ts":"2025-05-09T09:11:18Z","logger":"controllers.APIManager","msg":"Delete object 'v1.PrometheusRule/threescale-kube-state-metrics'"}
{"level":"info","ts":"2025-05-09T09:11:18Z","logger":"olm","msg":"Found deployments with status ","stopped":[],"starting":[],"ready":["apicast-production","apicast-staging","backend-cron","backend-listener","backend-redis","backend-worker","system-app","system-memcache","system-mysql","system-redis","system-searchd","system-sidekiq","zync","zync-database","zync-que"]}

Details

Description

Attachments

Easy Agile Planning Poker

Activity

People

Dates