Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-56552

[IBMCloud] install cluster in ca-mon region "Failed getting LoadBalancer"

XMLWordPrintable

    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • Proposed
    • Known Issue
    • Hide
      *Cause*: the user action or circumstances that trigger the bug
      *Consequence*: what the user experience is when the bug occurs
      *Workaround*: if available
      *Result*: can not install cluster in "ca-mon" region
      Show
      *Cause*: the user action or circumstances that trigger the bug *Consequence*: what the user experience is when the bug occurs *Workaround*: if available *Result*: can not install cluster in "ca-mon" region
    • None
    • None
    • None
    • None

      Description of problem:

      install cluster on "ca-mon" region failed    

      Version-Release number of selected component (if applicable):

       4.19   

      How reproducible:

      Always   

      Steps to Reproduce:

          1.specify the vm type as "bx3d-4x20" and the region "ca-mon" in install-config.yaml
          2. ipi install
          3.
          

      Actual results:

       install failed
      $oc get co | grep -v 'True .*False .*False'   
      NAME                       VERSION                              AVAILABLE   PROGRESSING   DEGRADED   SINCE   MESSAGE
      authentication             4.19.0-0.nightly-2025-05-19-005500   False       False         True       3h9m    OAuthServerRouteEndpointAccessibleControllerAvailable: Get "https://oauth-openshift.apps.maxu-mon-21.ibmcloud.qe.devcluster.openshift.com/healthz": dial tcp: lookup oauth-openshift.apps.maxu-mon-21.ibmcloud.qe.devcluster.openshift.com on 172.30.0.10:53: no such host (this is likely result of malfunctioning DNS server)
      console                    4.19.0-0.nightly-2025-05-19-005500   False       True          True       176m    DeploymentAvailable: 0 replicas available for console deployment
      RouteHealthAvailable: failed to GET route (https://console-openshift-console.apps.maxu-mon-21.ibmcloud.qe.devcluster.openshift.com): Get "https://console-openshift-console.apps.maxu-mon-21.ibmcloud.qe.devcluster.openshift.com": dial tcp: lookup console-openshift-console.apps.maxu-mon-21.ibmcloud.qe.devcluster.openshift.com on 172.30.0.10:53: no such host
      ingress                                                          False       True          True       3h8m    The "default" ingress controller reports Available=False: IngressControllerUnavailable: One or more status conditions indicate unavailable: LoadBalancerReady=False (SyncLoadBalancerFailed: The service-controller component is reporting SyncLoadBalancerFailed events like: Error syncing load balancer: failed to ensure load balancer: Error on cloud load balancer kube-maxu-mon-21-crsfr-eacdd324593d46f28803f41550784644 for service openshift-ingress/router-default with UID eacdd324-593d-46f2-8803-f41550784644: Failed getting LoadBalancer: Get "https://ca-mon.private.iaas.cloud.ibm.com/v1/load_balancers?generation=2&version=2024-12-17": dial tcp: lookup ca-mon.private.iaas.cloud.ibm.com on 161.26.0.10:53: no such host
      The cloud-controller-manager logs may contain more details.)
      $oc describe pod installer-2-maxu-mon-21-crsfr-master-0 -n openshift-kube-controller-manager 
      I0521 02:11:57.418577       1 copy.go:52] Failed to get config map openshift-kube-controller-manager/client-ca: configmaps "client-ca" not found
      F0521 02:11:57.620972       1 cmd.go:109] failed to copy: configmaps "client-ca" not found 

      Expected results:

      install succeed.    

      Additional info:

      $oc logs -n openshift-cloud-controller-manager -c cloud-controller-manager  ibm-cloud-controller-manager-869696d565-jtbjq
      I0521 05:26:55.087135       1 ibm_vpc_cloud.go:125] EnsureLoadBalancer(lbName:kube-maxu-mon-21-crsfr-eacdd324593d46f28803f41550784644, Service:{Name:router-default NameSpace:openshift-ingress UID:eacdd324-593d-46f2-8803-f41550784644 Annotations:map[service.kubernetes.io/ibm-load-balancer-cloud-provider-ip-type:public] Ports:[tcp-80-32555 tcp-443-31725] ExternalTrafficPolicy:Cluster HealthCheckNodePort:0 Status:[]}, NodeCount:6)
      I0521 05:26:55.087216       1 event.go:389] "Event occurred" object="openshift-ingress/router-default" fieldPath="" kind="Service" apiVersion="v1" type="Normal" reason="EnsuringLoadBalancer" message="Ensuring load balancer"
      E0521 05:26:55.143033       1 vpc_provider.go:100] Failed getting LoadBalancer: Get "https://ca-mon.private.iaas.cloud.ibm.com/v1/load_balancers?generation=2&version=2024-12-17": dial tcp: lookup ca-mon.private.iaas.cloud.ibm.com on 161.26.0.10:53: no such host
      E0521 05:26:55.143134       1 controller.go:301] "Unhandled Error" err="error processing service openshift-ingress/router-default (retrying with exponential backoff): failed to ensure load balancer: Error on cloud load balancer kube-maxu-mon-21-crsfr-eacdd324593d46f28803f41550784644 for service openshift-ingress/router-default with UID eacdd324-593d-46f2-8803-f41550784644: Failed getting LoadBalancer: Get \"https://ca-mon.private.iaas.cloud.ibm.com/v1/load_balancers?generation=2&version=2024-12-17\": dial tcp: lookup ca-mon.private.iaas.cloud.ibm.com on 161.26.0.10:53: no such host"
      I0521 05:26:55.143197       1 event.go:377] Event(v1.ObjectReference{Kind:"Service", Namespace:"openshift-ingress", Name:"router-default", UID:"eacdd324-593d-46f2-8803-f41550784644", APIVersion:"v1", ResourceVersion:"9888", FieldPath:""}): type: 'Warning' reason: 'CreatingCloudLoadBalancerFailed' Error on cloud load balancer kube-maxu-mon-21-crsfr-eacdd324593d46f28803f41550784644 for service openshift-ingress/router-default with UID eacdd324-593d-46f2-8803-f41550784644: Failed getting LoadBalancer: Get "https://ca-mon.private.iaas.cloud.ibm.com/v1/load_balancers?generation=2&version=2024-12-17": dial tcp: lookup ca-mon.private.iaas.cloud.ibm.com on 161.26.0.10:53: no such host
      I0521 05:26:55.143215       1 event.go:389] "Event occurred" object="openshift-ingress/router-default" fieldPath="" kind="Service" apiVersion="v1" type="Warning" reason="SyncLoadBalancerFailed" message="Error syncing load balancer: failed to ensure load balancer: Error on cloud load balancer kube-maxu-mon-21-crsfr-eacdd324593d46f28803f41550784644 for service openshift-ingress/router-default with UID eacdd324-593d-46f2-8803-f41550784644: Failed getting LoadBalancer: Get \"https://ca-mon.private.iaas.cloud.ibm.com/v1/load_balancers?generation=2&version=2024-12-17\": dial tcp: lookup ca-mon.private.iaas.cloud.ibm.com on 161.26.0.10:53: no such host"
      I0521 05:27:17.211583       1 ibm_loadbalancer.go:148] Monitoring load balancers ...
      E0521 05:27:17.261961       1 vpc_provider.go:368] Failed retrieving VPC LBs: Get "https://ca-mon.private.iaas.cloud.ibm.com/v1/load_balancers?generation=2&version=2024-12-17": dial tcp: lookup ca-mon.private.iaas.cloud.ibm.com on 161.26.0.10:53: no such host
       

              cschaefe@redhat.com Christopher Schaefer
              maxu@redhat.com May Xu
              None
              None
              May Xu May Xu
              None
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: