-
Bug
-
Resolution: Done
-
Critical
-
None
-
quay-v3.8.0
-
False
-
None
-
False
Description of problem:
For build function, a very important step is to download builder image quay-quay-builder-rhel8:v3.8.0 from brew.registry.redhat.io (test environment) or registry.redhat.io (customer environment). But these two registries do not support IPV6. So builder pod can't be downloaded in IPV6 environment.
Version-Release number of selected component (if applicable):
quay v3.8.0
registry.redhat.io/quay/quay-operator-rhel8@sha256:3cc8300710d1ea542d9aff3d524566b575e8df48d845ae0fd6506a719bc8205f
registry.redhat.io/quay/quay-rhel8@sha256:299a48cbedf65ba912799bb65ef859206c58e66c32ce6d225a51de78e1bcb098
brew.registry.redhat.io/rh-osbs/quay-quay-builder-rhel8:v3.8.0
How reproducible:
always
Steps to Reproduce:
1. deploy quay 3.8
2. enable kubernetesPodman build
3. trigger build process
Actual results:
The builder pod can't start due to download builder image from registry.access.redhat.com unsuccessfully.
$ oc get all -n virtual-builds NAME READY STATUS RESTARTS AGE pod/768aa4d8-4deb-448f-b6fe-97e6e4823fae-kdnr2-mfnms 0/1 Error 0 64s ....... $ oc -n virtual-builds logs 768aa4d8-4deb-448f-b6fe-97e6e4823fae-kdnr2-mfnms ......... time="2022-08-31T06:05:29Z" level=debug msg="Accessing \"registry.access.redhat.com/ubi7/ubi:latest\" failed: pinging container registry registry.access.redhat.com: Get \"https://registry.access.redhat.com/v2/\": dial tcp 23.221.22.209:443: connect: network is unreachable" time="2022-08-31T06:05:29Z" level=debug msg="Error pulling candidate registry.access.redhat.com/ubi7/ubi:latest: initializing source docker://registry.access.redhat.com/ubi7/ubi:latest: pinging container registry registry.access.redhat.com: Get \"https://registry.access.redhat.com/v2/\": dial tcp 23.221.22.209:443: connect: network is unreachable" @ - - [31/Aug/2022:06:05:26 +0000] "POST /v3.4.2/libpod/images/pull?password=&reference=registry.access.redhat.com%2Fubi7%2Fubi%3Alatest&username= HTTP/1.1" 200 324 "" "Go-http-client/1.1" time="2022-08-31T06:05:29Z" level=debug msg="IdleTracker:idle 1m+0h/2t connection(s)" X-Reference-Id=0xc000136030 time="2022-08-31T06:05:29Z" level=info msg="failed docker request attempt #2: err: initializing source docker://registry.access.redhat.com/ubi7/ubi:latest: pinging container registry registry.access.redhat.com: Get \"https://registry.access.redhat.com/v2/\": dial tcp 23.221.22.209:443: connect: network is unreachable err response %!s(<nil>)" time="2022-08-31T06:05:29Z" level=fatal msg="failed to build buildpack: initializing source docker://registry.access.redhat.com/ubi7/ubi:latest: pinging container registry registry.access.redhat.com: Get \"https://registry.access.redhat.com/v2/\": dial tcp 23.221.22.209:443: connect: network is unreachable"
Expected results:
quay-builder image can be downloaded and start successfully.
Additional info:
$ host brew.registry.redhat.io brew.registry.redhat.io is an alias for wildcard.apps.ext.spoke.prod.us-east-1.aws.paas.redhat.com. wildcard.apps.ext.spoke.prod.us-east-1.aws.paas.redhat.com is an alias for eeksgq.external-router-shard.mpp-e1-prod.9e4s.p1.openshiftapps.com. eeksgq.external-router-shard.mpp-e1-prod.9e4s.p1.openshiftapps.com has address 54.165.172.3 eeksgq.external-router-shard.mpp-e1-prod.9e4s.p1.openshiftapps.com has address 54.84.76.225 eeksgq.external-router-shard.mpp-e1-prod.9e4s.p1.openshiftapps.com has address 3.210.8.154
$ host registry.redhat.io registry.redhat.io is an alias for registry.redhat.io.edgekey.net. registry.redhat.io.edgekey.net is an alias for e14353.g.akamaiedge.net. e14353.g.akamaiedge.net has address 104.91.76.120
$ host registry.access.redhat.com registry.access.redhat.com is an alias for registry.access.redhat.com2.edgekey.net. registry.access.redhat.com2.edgekey.net is an alias for registry.access.redhat.com2.edgekey.net.globalredir.akadns.net. registry.access.redhat.com2.edgekey.net.globalredir.akadns.net is an alias for e40408.d.akamaiedge.net. e40408.d.akamaiedge.net has address 23.40.240.25 e40408.d.akamaiedge.net has address 23.40.240.65
$ oc get pod
NAME READY STATUS RESTARTS AGE
quay-operator.v3.8.0-79fd4c95df-vlqm8 1/1 Running 0 174m
quayregistry-clair-app-57bbf85fdb-6mk5z 1/1 Running 0 71m
quayregistry-clair-app-57bbf85fdb-j4jjv 1/1 Running 0 71m
quayregistry-clair-postgres-56f4957db-69rq8 1/1 Running 1 (170m ago) 171m
quayregistry-quay-app-55fc59686d-2jxdn 1/1 Running 0 66m
quayregistry-quay-app-55fc59686d-wv8xw 1/1 Running 0 66m
quayregistry-quay-app-upgrade-kjtvr 0/1 Completed 0 171m
quayregistry-quay-config-editor-554f547fd5-rhfm8 1/1 Running 0 66m
quayregistry-quay-database-7dfcfd6c7f-rl4fq 1/1 Running 0 171m
quayregistry-quay-mirror-7cb449b7bf-b8xjr 1/1 Running 0 66m
quayregistry-quay-mirror-7cb449b7bf-qgw2h 1/1 Running 0 66m
quayregistry-quay-redis-66fdd5db87-mvtk9 1/1 Running 0 71m
Attach the whole log of builder pod and quay pod in attachment.