-
Bug
-
Resolution: Unresolved
-
Major
-
None
-
None
-
None
-
Quality / Stability / Reliability
-
False
-
-
False
-
-
-
None
This is issue reported internally in RH, by MTA QE.
Description of problem:
When installing MTA on OCP, mta-rhbk-0 pod is terminated and recreated several times till it becomes stable. (screencast is attached)
This behavior affects our RBAC automation tests for MTA because we attempt to access the Keycloak UI too early, based on that the pod has reached the Ready state.
If this is expected behavior, could you please provide a `kubectl` command to ensure the pod is stable?
Attachments:
rhbk-operator.log
keycloak-rolling-update.webm
Additional info:
$ oc get events -n openshift-mta --field-selector involvedObject.kind=Pod,involvedObject.name=mta-rhbk-0 LAST SEEN TYPE REASON OBJECT MESSAGE 12m Normal Scheduled pod/mta-rhbk-0 Successfully assigned openshift-mta/mta-rhbk-0 to mtv02-c29nj-worker-0-kt6c2 12m Warning FailedMount pod/mta-rhbk-0 MountVolume.SetUp failed for volume "keycloak-tls-certificates" : secret "mta-rhbk-serving-cert" not found 11m Normal AddedInterface pod/mta-rhbk-0 Add eth0 [10.128.2.67/23] from ovn-kubernetes 11m Normal Pulling pod/mta-rhbk-0 Pulling image "registry.redhat.io/rhbk/keycloak-rhel9@sha256:44afed35866aceb10801185e204eeb17e53d7d95662bdace02faa7e5eae4aa13" 11m Normal Pulled pod/mta-rhbk-0 Successfully pulled image "registry.redhat.io/rhbk/keycloak-rhel9@sha256:44afed35866aceb10801185e204eeb17e53d7d95662bdace02faa7e5eae4aa13" in 1.288s (1.288s including waiting). Image size: 465254360 bytes. 11m Normal Created pod/mta-rhbk-0 Created container: keycloak 11m Normal Started pod/mta-rhbk-0 Started container keycloak 11m Warning ProbeError pod/mta-rhbk-0 Startup probe error: Get "https://10.128.2.67:9000/auth/health/started": dial tcp 10.128.2.67:9000: connect: connection refused... 11m Warning Unhealthy pod/mta-rhbk-0 Startup probe failed: Get "https://10.128.2.67:9000/auth/health/started": dial tcp 10.128.2.67:9000: connect: connection refused 10m Normal Killing pod/mta-rhbk-0 Stopping container keycloak 10m Normal Scheduled pod/mta-rhbk-0 Successfully assigned openshift-mta/mta-rhbk-0 to mtv02-c29nj-worker-0-kt6c2 10m Normal AddedInterface pod/mta-rhbk-0 Add eth0 [10.128.2.68/23] from ovn-kubernetes 10m Normal Pulling pod/mta-rhbk-0 Pulling image "registry.redhat.io/rhbk/keycloak-rhel9@sha256:44afed35866aceb10801185e204eeb17e53d7d95662bdace02faa7e5eae4aa13" 10m Normal Pulled pod/mta-rhbk-0 Successfully pulled image "registry.redhat.io/rhbk/keycloak-rhel9@sha256:44afed35866aceb10801185e204eeb17e53d7d95662bdace02faa7e5eae4aa13" in 504ms (504ms including waiting). Image size: 465254360 bytes. 10m Normal Created pod/mta-rhbk-0 Created container: keycloak 10m Normal Started pod/mta-rhbk-0 Started container keycloak 10m Warning ProbeError pod/mta-rhbk-0 Startup probe error: Get "https://10.128.2.68:9000/auth/health/started": dial tcp 10.128.2.68:9000: connect: connection refused... 10m Warning Unhealthy pod/mta-rhbk-0 Startup probe failed: Get "https://10.128.2.68:9000/auth/health/started": dial tcp 10.128.2.68:9000: connect: connection refused 9m5s Normal Killing pod/mta-rhbk-0 Stopping container keycloak 9m3s Normal Scheduled pod/mta-rhbk-0 Successfully assigned openshift-mta/mta-rhbk-0 to mtv02-c29nj-worker-0-kt6c2 9m3s Normal AddedInterface pod/mta-rhbk-0 Add eth0 [10.128.2.70/23] from ovn-kubernetes 9m3s Normal Pulling pod/mta-rhbk-0 Pulling image "registry.redhat.io/rhbk/keycloak-rhel9@sha256:44afed35866aceb10801185e204eeb17e53d7d95662bdace02faa7e5eae4aa13" 9m3s Normal Pulled pod/mta-rhbk-0 Successfully pulled image "registry.redhat.io/rhbk/keycloak-rhel9@sha256:44afed35866aceb10801185e204eeb17e53d7d95662bdace02faa7e5eae4aa13" in 641ms (641ms including waiting). Image size: 465254360 bytes. 9m3s Normal Created pod/mta-rhbk-0 Created container: keycloak 9m3s Normal Started pod/mta-rhbk-0 Started container keycloak 8m50s Warning ProbeError pod/mta-rhbk-0 Startup probe error: Get "https://10.128.2.70:9000/auth/health/started": dial tcp 10.128.2.70:9000: connect: connection refused... 8m51s Warning Unhealthy pod/mta-rhbk-0 Startup probe failed: Get "https://10.128.2.70:9000/auth/health/started": dial tcp 10.128.2.70:9000: connect: connection refused
Versions:
RHBK 26.4.7
MTA 8.0.1
