-
Bug
-
Resolution: Unresolved
-
Normal
-
None
-
4.16.0
-
None
-
Moderate
-
No
-
False
-
Description of problem:
4.16 IPI disconnected installation is failing on powerVS. With the following error message:
level=error msg="Attempted to gather ClusterOperator status after installation failure: listing ClusterOperator objects: Get \"https://api.ocp-disc4-dal10.ocp-disc2-dns.com:6443/apis/config.openshift.io/v1/clusteroperators\": EOF" time="2024-06-26T13:46:17Z" level=error msg="Bootstrap failed to complete: Get \"https://api.ocp-disc4-dal10.ocp-disc2-dns.com:6443/version\": EOF" time="2024-06-26T13:46:17Z" level=error msg="Failed waiting for Kubernetes API. This error usually happens when there is a problem on the bootstrap host that prevents creating a temporary control plane."
Checked the console for the bootstrap node. The below error message was seen:
Unable to pull the release image
Successfully able to pull the mirror image from the local registry into the mirror vm:
# podman pull --authfile ~/pull_secret.json registry.ipi-test.ocp-disc2-dns.com:5000/ocp4/openshift4:4.16.0-ppc64le Trying to pull registry.ipi-test.ocp-disc2-dns.com:5000/ocp4/openshift4:4.16.0-ppc64le... Getting image source signatures Copying blob d92958f33655 done Copying blob 0c2f5411db88 done Copying blob d25dd898f47a done Copying blob a34ed9377771 done Copying blob 5124657e0c35 done Copying config 6244ac50be done Writing manifest to image destination Storing signatures 6244ac50beb63c257743a83287982bec8e0777f2fc91bbda36c308fe0ca65d4d
Also, able to ping the private IP of the mirror VM from the bootstrap node. However, failed to pull the mirrored image from the bootstrap node.
Error logs from the bootstrap:
DEBU[0000] GET https://registry.ipi-test.ocp-disc2-dns.com:5000/v2/ DEBU[0030] Ping https://registry.ipi-test.ocp-disc2-dns.com:5000/v2/ err Get "https://registry.ipi-test.ocp-disc2-dns.com:5000/v2/": dial tcp 10.240.65.33:5000: i/o timeout (&url.Error{Op:"Get", URL:"https://registry.ipi-test.ocp-disc2-dns.com:5000/v2/", Err:(*net.OpError)(0xc0004ed630)}) DEBU[0030] GET https://registry.ipi-test.ocp-disc2-dns.com:5000/v1/_ping DEBU[0060] Ping https://registry.ipi-test.ocp-disc2-dns.com:5000/v1/_ping err Get "https://registry.ipi-test.ocp-disc2-dns.com:5000/v1/_ping": dial tcp 10.240.65.33:5000: i/o timeout (&url.Error{Op:"Get", URL:"https://registry.ipi-test.ocp-disc2-dns.com:5000/v1/_ping", Err:(*net.OpError)(0xc000420690)}) DEBU[0060] Accessing "registry.ipi-test.ocp-disc2-dns.com:5000/ocp4/openshift4:4.16.0-ppc64le" failed: pinging container registry registry.ipi-test.ocp-disc2-dns.com:5000: Get "https://registry.ipi-test.ocp-disc2-dns.com:5000/v2/": dial tcp 10.240.65.33:5000: i/o timeout WARN[0060] Failed, retrying in 1s ... (1/3). Error: initializing source docker://registry.ipi-test.ocp-disc2-dns.com:5000/ocp4/openshift4:4.16.0-ppc64le: pinging container registry registry.ipi-test.ocp-disc2-dns.com:5000: Get "https://registry.ipi-test.ocp-disc2-dns.com:5000/v2/": dial tcp 10.240.65.33:5000: i/o timeout
Added
Version-Release number of selected component (if applicable):
How reproducible:
Always
Steps to Reproduce:
1. Deploy 4.16 IPI disconnected cluster with terraform on powerVS
2. Deployment failed with the above error message.
Actual results:
Deployment failed with the error:
level=error msg="Bootstrap failed to complete: Get \"https://api.ocp-disc4-dal10.ocp-disc2-dns.com:6443/version\": EOF" time="2024-06-26T13:46:17Z" level=error msg="Failed waiting for Kubernetes API. This error usually happens when there is a problem on the bootstrap host that prevents creating a temporary control plane."
Expected results:
4.16 IPI disconnected installation completes without an issue.
Additional info:
