-
Bug
-
Resolution: Unresolved
-
Normal
-
None
-
4.16.z
-
None
-
Important
-
No
-
False
-
Description of problem:
Using https://gitlab.cee.redhat.com/aosqe/flexy-templates/-/blob/master/functionality-testing/aos-4_16/ipi-on-aws/versioned-installer-customer_vpc-disconnected_private_cluster-baselinecaps-none-ci to provision the cluster but the see the below error time="2024-07-04T05:15:05Z" level=info msg="Failed to gather bootstrap logs: failed to connect to the bootstrap machine: dial tcp 10.0.75.38:22: connect: connection timed out" time="2024-07-04T05:15:06Z" level=error msg="Cluster operator authentication Degraded is True with IngressStateEndpoints_MissingSubsets::OAuthServerServiceEndpointAccessibleController_SyncError::OAuthServerServiceEndpointsEndpointAccessibleController_SyncError: IngressStateEndpointsDegraded: No subsets found for the endpoints of oauth-server\nOAuthServerServiceEndpointAccessibleControllerDegraded: Get \"https://172.30.107.16:443/healthz\": dial tcp 172.30.107.16:443: connect: connection refused\nOAuthServerServiceEndpointsEndpointAccessibleControllerDegraded: oauth service endpoints are not ready" time="2024-07-04T05:15:06Z" level=error msg="Cluster operator authentication Available is False with APIServices_PreconditionNotReady::OAuthServerServiceEndpointAccessibleController_EndpointUnavailable::OAuthServerServiceEndpointsEndpointAccessibleController_ResourceNotFound: APIServicesAvailable: PreconditionNotReady\nOAuthServerServiceEndpointAccessibleControllerAvailable: Get \"https://172.30.107.16:443/healthz\": dial tcp 172.30.107.16:443: connect: connection refused\nOAuthServerServiceEndpointsEndpointAccessibleControllerAvailable: endpoints \"oauth-openshift\" not found" ...
Version-Release number of selected component (if applicable):
4.16
How reproducible:
Always
Steps to Reproduce:
1. Try to install cluster
Actual results:
From installation log: https://mastern-jenkins-csb-openshift-qe.apps.ocp-c1.prod.psi.redhat.com/job/ocp-common/job/Flexy-install/295[…]l-dir/.openshift_install.log/*view*/ time="2024-07-04T05:15:05Z" level=info msg="Failed to gather bootstrap logs: failed to connect to the bootstrap machine: dial tcp 10.0.75.38:22: connect: connection timed out" time="2024-07-04T05:15:06Z" level=error msg="Cluster operator authentication Degraded is True with IngressStateEndpoints_MissingSubsets::OAuthServerServiceEndpointAccessibleController_SyncError::OAuthServerServiceEndpointsEndpointAccessibleController_SyncError: IngressStateEndpointsDegraded: No subsets found for the endpoints of oauth-server\nOAuthServerServiceEndpointAccessibleControllerDegraded: Get \"https://172.30.107.16:443/healthz\": dial tcp 172.30.107.16:443: connect: connection refused\nOAuthServerServiceEndpointsEndpointAccessibleControllerDegraded: oauth service endpoints are not ready" time="2024-07-04T05:15:06Z" level=error msg="Cluster operator authentication Available is False with APIServices_PreconditionNotReady::OAuthServerServiceEndpointAccessibleController_EndpointUnavailable::OAuthServerServiceEndpointsEndpointAccessibleController_ResourceNotFound: APIServicesAvailable: PreconditionNotReady\nOAuthServerServiceEndpointAccessibleControllerAvailable: Get \"https://172.30.107.16:443/healthz\": dial tcp 172.30.107.16:443: connect: connection refused\nOAuthServerServiceEndpointsEndpointAccessibleControllerAvailable: endpoints \"oauth-openshift\" not found" ... time="2024-07-04T05:16:16Z" level=info msg="Waiting up to 40m0s (until 5:56AM UTC) for the cluster at https://api.bcjit.qe.devcluster.openshift.com:6443 to initialize..." time="2024-07-04T05:16:16Z" level=debug msg="Still waiting for the cluster to initialize: Multiple errors are preventing progress:\n* Cluster operators authentication, ingress, monitoring, openshift-apiserver are not available\n* Could not update imagestream \"openshift/cli\" (494 of 894): resource may have been deleted\n* Could not update imagestream \"openshift/driver-toolkit\" (614 of 894): resource may have been deleted" time="2024-07-04T05:32:57Z" level=debug msg="Still waiting for the cluster to initialize: Multiple errors are preventing progress:\n* Cluster operators authentication, ingress, monitoring, openshift-apiserver are not available\n* Could not update imagestream \"openshift/cli\" (494 of 894): resource may have been deleted\n* Could not update imagestream \"openshift/driver-toolkit\" (614 of 894): resource may have been deleted" time="2024-07-04T05:34:46Z" level=debug msg="Still waiting for the cluster to initialize: Working towards 4.16.0-0.nightly-2024-07-03-161813" time="2024-07-04T05:34:46Z" level=debug msg="Still waiting for the cluster to initialize: Working towards 4.16.0-0.nightly-2024-07-03-161813: 23 of 894 done (2% complete)" time="2024-07-04T05:34:46Z" level=debug msg="Still waiting for the cluster to initialize: Working towards 4.16.0-0.nightly-2024-07-03-161813: 76 of 894 done (8% complete)" time="2024-07-04T05:34:46Z" level=debug msg="Still waiting for the cluster to initialize: Working towards 4.16.0-0.nightly-2024-07-03-161813: 77 of 894 done (8% complete)"We can see the authentication co was unable to get ready, endpoints \"oauth-openshift\" not found" indicates oauth apiserver doesn't work.
Expected results:
Installation should be successfull
Additional info:
https://redhat-internal.slack.com/archives/CH76YSYSC/p1720076493887469