Uploaded image for project: 'Project Quay'
  1. Project Quay
  2. PROJQUAY-4382

build function can't work on IPV6 due to brew.registry.redhat.io and registry.redhat.io don't support IPv6

    XMLWordPrintable

Details

    • Bug
    • Resolution: Done
    • Critical
    • None
    • quay-v3.8.0
    • quay-builder
    • False
    • None
    • False
    • 0

    Description

      Description of problem:

      For build function, a very important step is to download builder image quay-quay-builder-rhel8:v3.8.0 from brew.registry.redhat.io (test environment) or registry.redhat.io (customer environment).  But these two registries do not support IPV6. So builder pod can't be downloaded in IPV6 environment.

      Version-Release number of selected component (if applicable):

       

      quay v3.8.0
      registry.redhat.io/quay/quay-operator-rhel8@sha256:3cc8300710d1ea542d9aff3d524566b575e8df48d845ae0fd6506a719bc8205f
      registry.redhat.io/quay/quay-rhel8@sha256:299a48cbedf65ba912799bb65ef859206c58e66c32ce6d225a51de78e1bcb098
      brew.registry.redhat.io/rh-osbs/quay-quay-builder-rhel8:v3.8.0

       

      How reproducible:

      always

      Steps to Reproduce:
      1. deploy quay 3.8
      2. enable kubernetesPodman build 
      3. trigger build process

      Actual results:

      The builder pod can't start due to download builder image from registry.access.redhat.com unsuccessfully.

       

      $ oc get all -n virtual-builds
      NAME                                                   READY   STATUS   RESTARTS   AGE
      pod/768aa4d8-4deb-448f-b6fe-97e6e4823fae-kdnr2-mfnms   0/1     Error    0          64s
      .......
       
      $ oc -n virtual-builds logs 768aa4d8-4deb-448f-b6fe-97e6e4823fae-kdnr2-mfnms
      .........
      time="2022-08-31T06:05:29Z" level=debug msg="Accessing \"registry.access.redhat.com/ubi7/ubi:latest\" failed: pinging container registry registry.access.redhat.com: Get \"https://registry.access.redhat.com/v2/\": dial tcp 23.221.22.209:443: connect: network is unreachable"
      time="2022-08-31T06:05:29Z" level=debug msg="Error pulling candidate registry.access.redhat.com/ubi7/ubi:latest: initializing source docker://registry.access.redhat.com/ubi7/ubi:latest: pinging container registry registry.access.redhat.com: Get \"https://registry.access.redhat.com/v2/\": dial tcp 23.221.22.209:443: connect: network is unreachable"
      @ - - [31/Aug/2022:06:05:26 +0000] "POST /v3.4.2/libpod/images/pull?password=&reference=registry.access.redhat.com%2Fubi7%2Fubi%3Alatest&username= HTTP/1.1" 200 324 "" "Go-http-client/1.1"
      time="2022-08-31T06:05:29Z" level=debug msg="IdleTracker:idle 1m+0h/2t connection(s)" X-Reference-Id=0xc000136030
      time="2022-08-31T06:05:29Z" level=info msg="failed docker request attempt #2: err: initializing source docker://registry.access.redhat.com/ubi7/ubi:latest: pinging container registry registry.access.redhat.com: Get \"https://registry.access.redhat.com/v2/\": dial tcp 23.221.22.209:443: connect: network is unreachable err response %!s(<nil>)"
      time="2022-08-31T06:05:29Z" level=fatal msg="failed to build buildpack: initializing source docker://registry.access.redhat.com/ubi7/ubi:latest: pinging container registry registry.access.redhat.com: Get \"https://registry.access.redhat.com/v2/\": dial tcp 23.221.22.209:443: connect: network is unreachable"
      

      Expected results:

      quay-builder image can be downloaded and start successfully.

      Additional info:

      $ host brew.registry.redhat.io
      brew.registry.redhat.io is an alias for wildcard.apps.ext.spoke.prod.us-east-1.aws.paas.redhat.com.
      wildcard.apps.ext.spoke.prod.us-east-1.aws.paas.redhat.com is an alias for eeksgq.external-router-shard.mpp-e1-prod.9e4s.p1.openshiftapps.com.
      eeksgq.external-router-shard.mpp-e1-prod.9e4s.p1.openshiftapps.com has address 54.165.172.3
      eeksgq.external-router-shard.mpp-e1-prod.9e4s.p1.openshiftapps.com has address 54.84.76.225
      eeksgq.external-router-shard.mpp-e1-prod.9e4s.p1.openshiftapps.com has address 3.210.8.154
      $ host registry.redhat.io
      registry.redhat.io is an alias for registry.redhat.io.edgekey.net.
      registry.redhat.io.edgekey.net is an alias for e14353.g.akamaiedge.net.
      e14353.g.akamaiedge.net has address 104.91.76.120
      $ host registry.access.redhat.com
      registry.access.redhat.com is an alias for registry.access.redhat.com2.edgekey.net.
      registry.access.redhat.com2.edgekey.net is an alias for registry.access.redhat.com2.edgekey.net.globalredir.akadns.net.
      registry.access.redhat.com2.edgekey.net.globalredir.akadns.net is an alias for e40408.d.akamaiedge.net.
      e40408.d.akamaiedge.net has address 23.40.240.25
      e40408.d.akamaiedge.net has address 23.40.240.65
      $ oc get pod
      NAME                                               READY   STATUS      RESTARTS       AGE
      quay-operator.v3.8.0-79fd4c95df-vlqm8              1/1     Running     0              174m
      quayregistry-clair-app-57bbf85fdb-6mk5z            1/1     Running     0              71m
      quayregistry-clair-app-57bbf85fdb-j4jjv            1/1     Running     0              71m
      quayregistry-clair-postgres-56f4957db-69rq8        1/1     Running     1 (170m ago)   171m
      quayregistry-quay-app-55fc59686d-2jxdn             1/1     Running     0              66m
      quayregistry-quay-app-55fc59686d-wv8xw             1/1     Running     0              66m
      quayregistry-quay-app-upgrade-kjtvr                0/1     Completed   0              171m
      quayregistry-quay-config-editor-554f547fd5-rhfm8   1/1     Running     0              66m
      quayregistry-quay-database-7dfcfd6c7f-rl4fq        1/1     Running     0              171m
      quayregistry-quay-mirror-7cb449b7bf-b8xjr          1/1     Running     0              66m
      quayregistry-quay-mirror-7cb449b7bf-qgw2h          1/1     Running     0              66m
      quayregistry-quay-redis-66fdd5db87-mvtk9           1/1     Running     0              71m

      Attach the whole log of builder pod and quay pod in attachment.

      Attachments

        Activity

          People

            Unassigned Unassigned
            rhwhu Weihua Hu
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: