Uploaded image for project: 'Project Quay'
  1. Project Quay
  2. PROJQUAY-5486

mirror registry for Red Hat OpenShift fails to install with 127 in RHEL 9

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Cannot Reproduce
    • Icon: Critical Critical
    • None
    • quay-v3.8.6
    • -area/registry, quay.io
    • False
    • None
    • False
    • Important

      Seeing below logs while trying to install the mirror registry for Red Hat OpenShift in RHEL 9.

      ~~~

      $ sudo ./mirror-registry install   --quayHostname mirror.testcluster.com --quayRoot /opt/quay -v

         __   __
        /  \ /  \     ______   _    _     __   __   __
       / /\ / /\ \   /  __  \ | |  | |   /  \  \ \ / /
      / /  / /  \ \  | |  | | | |  | |  / /\ \  \   /
      \ \  \ \  / /  | |{}| | | |{}| | / ____ \  | |
       \ \/ \ \/ /   _  {}{}/  {}{}/ //{}    \ ||
        {}/ {}/      \ __
                        ___\ by Red Hat
       Build, Store, and Distribute your Containers
          
      INFO[2023-05-11 16:00:50] Install has begun                            
      DEBU[2023-05-11 16:00:50] Ansible Execution Environment Image: quay.io/quay/mirror-registry-ee:latest 
      DEBU[2023-05-11 16:00:50] Pause Image: registry.access.redhat.com/ubi8/pause:8.7-6 
      DEBU[2023-05-11 16:00:50] Quay Image: registry.redhat.io/quay/quay-rhel8:v3.8.6 
      DEBU[2023-05-11 16:00:50] Redis Image: registry.redhat.io/rhel8/redis-6:1-92.1669834635 
      DEBU[2023-05-11 16:00:50] Postgres Image: registry.redhat.io/rhel8/postgresql-10:1-203.1669834630 
      INFO[2023-05-11 16:00:50] Found execution environment at /home/ec2-user/execution-environment.tar 
      INFO[2023-05-11 16:00:50] Loading execution environment from execution-environment.tar 
      DEBU[2023-05-11 16:00:50] Importing execution enviornment with command: /bin/bash -c /usr/bin/podman image import \
                          --change 'ENV PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin' \
                          --change 'ENV HOME=/home/runner' \
                          --change 'ENV container=oci' \
                          --change 'ENTRYPOINT=["entrypoint"]' \
                          --change 'WORKDIR=/runner' \
                          --change 'EXPOSE=6379' \
                          --change 'VOLUME=/runner' \
                          --change 'CMD ["ansible-runner", "run", "/runner"]' \
                          - quay.io/quay/mirror-registry-ee:latest < /home/ec2-user/execution-environment.tar 
      Getting image source signatures
      Copying blob 63bb300c167d skipped: already exists  
      Copying config 39894c6e4d done  
      Writing manifest to image destination
      Storing signatures
      sha256:39894c6e4decab407277766201883ec807406b77700659d56ec81eae81b531ee
      INFO[2023-05-11 16:00:52] Detected an installation to localhost        
      INFO[2023-05-11 16:00:52] Found SSH key at /root/.ssh/quay_installer   
      INFO[2023-05-11 16:00:52] Attempting to set SELinux rules on /root/.ssh/quay_installer 
      INFO[2023-05-11 16:00:52] Found image archive at /home/ec2-user/image-archive.tar 
      INFO[2023-05-11 16:00:52] Detected an installation to localhost        
      INFO[2023-05-11 16:00:52] Unpacking image archive from /home/ec2-user/image-archive.tar 
      quay.tar
      redis.tar
      postgres.tar
      pause.tar
      INFO[2023-05-11 16:00:54] Loading pause image archive from pause.tar   
      DEBU[2023-05-11 16:00:54] Importing Pause with command: /bin/bash -c /usr/bin/podman image import \
                          --change 'ENV PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin' \
                          --change 'ENV container=oci' \
                          --change 'ENTRYPOINT=["sleep"]' \
                          --change 'CMD=["infinity"]' \
                          - registry.access.redhat.com/ubi8/pause:8.7-6 < pause.tar 
      Getting image source signatures
      Copying blob bd87c5e38685 skipped: already exists  
      Copying config a34c39d243 done  
      Writing manifest to image destination
      Storing signatures
      sha256:a34c39d243f99234a354c087d1324485b3439940e4e4bbf1e4cf4336203ac79f
      INFO[2023-05-11 16:00:59] Loading redis image archive from redis.tar   
      DEBU[2023-05-11 16:00:59] Importing Redis with command: /bin/bash -c /usr/bin/podman image import \
                          --change 'ENV PATH=/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin' \
                          --change 'ENV container=oci' \
                          --change 'ENV STI_SCRIPTS_URL=image:///usr/libexec/s2i' \
                          --change 'ENV STI_SCRIPTS_PATH=/usr/libexec/s2i' \
                          --change 'ENV APP_ROOT=/opt/app-root' \
                          --change 'ENV HOME=/var/lib/redis' \
                          --change 'ENV PLATFORM=el8' \
                          --change 'ENV REDIS_VERSION=6' \
                          --change 'ENV CONTAINER_SCRIPTS_PATH=/usr/share/container-scripts/redis' \
                          --change 'ENV REDIS_PREFIX=/usr' \
                          --change 'ENV REDIS_CONF=/etc/redis.conf' \
                          --change 'ENTRYPOINT=["container-entrypoint"]' \
                          --change 'USER=1001' \
                          --change 'WORKDIR=/opt/app-root/src' \
                          --change 'EXPOSE=6379' \
                          --change 'VOLUME=/var/lib/redis/data' \
                          --change 'CMD ["run-redis"]' \
                          - registry.redhat.io/rhel8/redis-6:1-92.1669834635 < redis.tar 
      Getting image source signatures
      Copying blob 2af86ed5ba0c skipped: already exists  
      Copying config 078ba5d015 done  
      Writing manifest to image destination
      Storing signatures
      sha256:078ba5d01544826853770ab2f538fe6e45b0c2cec388e632ea369ad1b68d1dbe
      INFO[2023-05-11 16:01:02] Loading postgres image archive from postgres.tar 
      DEBU[2023-05-11 16:01:02] Importing Postgres with command: /bin/bash -c /usr/bin/podman image import \
                          --change 'ENV PATH=/opt/app-root/src/bin:/opt/app-root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin' \
                          --change 'ENV STI_SCRIPTS_URL=image:///usr/libexec/s2i' \
                          --change 'ENV STI_SCRIPTS_PATH=/usr/libexec/s2i' \
                          --change 'ENV APP_ROOT=/opt/app-root' \
                          --change 'ENV APP_DATA=/opt/app-root' \
                          --change 'ENV HOME=/var/lib/pgsql' \
                          --change 'ENV PLATFORM=el8' \
                          --change 'ENV POSTGRESQL_VERSION=10' \
                          --change 'ENV POSTGRESQL_PREV_VERSION=9.6' \
                          --change 'ENV PGUSER=postgres' \
                          --change 'ENV CONTAINER_SCRIPTS_PATH=/usr/share/container-scripts/postgresql' \
                          --change 'ENTRYPOINT=["container-entrypoint"]' \
                          --change 'WORKDIR=/opt/app-root/src' \
                          --change 'EXPOSE=5432' \
                          --change 'USER=26' \
                          --change 'CMD ["run-postgresql"]' \
                          - registry.redhat.io/rhel8/postgresql-10:1-203.1669834630 < postgres.tar 
      Getting image source signatures
      Copying blob d25388378766 skipped: already exists  
      Copying config 49899b3007 done  
      Writing manifest to image destination
      Storing signatures
      sha256:49899b3007616e879da514fbabf9bffa3f8a2b87d825a1f37c1ea288f28c9e96
      INFO[2023-05-11 16:01:07] Loading Quay image archive from quay.tar     
      DEBU[2023-05-11 16:01:07] Importing Quay with command: /bin/bash -c /usr/bin/podman image import \
                          --change 'ENV PATH=/.local/bin/:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin' \
                          --change 'ENV RED_HAT_QUAY=true' \
                          --change 'ENV PYTHON_VERSION=3.8' \
                          --change 'ENV PYTHON_ROOT=/usr/local/lib/python3.8' \
                          --change 'ENV PYTHONUNBUFFERED=1' \
                          --change 'ENV PYTHONIOENCODING=UTF-8' \
                          --change 'ENV LANG=en_US.utf8' \
                          --change 'ENV QUAYDIR=/quay-registry' \
                          --change 'ENV QUAYCONF=/quay-registry/conf' \
                          --change 'ENV QUAYRUN=/quay-registry/conf' \
                          --change 'ENV QUAYPATH=.' \
                          --change 'ENV QUAY_VERSION=v3.8.6' \
                          --change 'ENV container=oci' \
                          --change 'ENTRYPOINT=["dumb-init","--","/quay-registry/quay-entrypoint.sh"]' \
                          --change 'WORKDIR=/quay-registry' \
                          --change 'EXPOSE=7443' \
                          --change 'EXPOSE=8080' \
                          --change 'EXPOSE=8443' \
                          --change 'VOLUME=/conf/stack' \
                          --change 'VOLUME=/datastorage' \
                          --change 'VOLUME=/tmp' \
                          --change 'VOLUME=/var/log' \
                          --change 'USER=1001' \
                          --change 'CMD ["registry"]' \
                          - registry.redhat.io/quay/quay-rhel8:v3.8.6 < quay.tar 
      Getting image source signatures
      Copying blob ed018e606bb8 skipped: already exists  
      Copying config 3776c01e52 done  
      Writing manifest to image destination
      Storing signatures
      sha256:3776c01e52dd73c089a07c7389201b6e3b9b114d85aa3eff4d423409286549c9
      INFO[2023-05-11 16:01:20] Attempting to set SELinux rules on image archive 
      INFO[2023-05-11 16:01:20] Running install playbook. This may take some time. To see playbook output run the installer with -v (verbose) flag. 
      INFO[2023-05-11 16:01:20] Detected an installation to localhost        
      DEBU[2023-05-11 16:01:20] Running command: podman run --rm --interactive --tty --workdir /runner/project --net host -v /home/ec2-user/image-archive.tar:/runner/image-archive.tar -v /root/.ssh/quay_installer:/runner/env/ssh_key -e RUNNER_OMIT_EVENTS=False -e RUNNER_ONLY_FAILED_EVENTS=False -e ANSIBLE_HOST_KEY_CHECKING=False -e ANSIBLE_CONFIG=/runner/project/ansible.cfg -e ANSIBLE_NOCOLOR=false --quiet --name ansible_runner_instance quay.io/quay/mirror-registry-ee:latest ansible-playbook -i root@mirror.testcluster.com, --private-key /runner/env/ssh_key -e "init_user=init init_password=biSmWQaD5f9P267g0LYOx8E1B4Ke3lwN quay_image=registry.redhat.io/quay/quay-rhel8:v3.8.6 quay_version=v3.8.6 redis_image=registry.redhat.io/rhel8/redis-6:1-92.1669834635 postgres_image=registry.redhat.io/rhel8/postgresql-10:1-203.1669834630 pause_image=registry.access.redhat.com/ubi8/pause:8.7-6 quay_hostname=mirror.testcluster.com:8443 local_install=true quay_root=/opt/quay quay_storage=quay-storage pg_storage=pg-storage" install_mirror_appliance.yml   
      ERRO[2023-05-11 16:01:20] An error occurred: exit status 127

      ~~~

       

      When I run the last command manually, it throws error for the image.

      ~~~

      $ podman run --rm --interactive --tty --workdir /runner/project --net host -v /home/ec2-user/image-archive.tar:/runner/image-archive.tar -v /root/.ssh/quay_installer:/runner/env/ssh_key -e RUNNER_OMIT_EVENTS=False -e RUNNER_ONLY_FAILED_EVENTS=False -e ANSIBLE_HOST_KEY_CHECKING=False -e ANSIBLE_CONFIG=/runner/project/ansible.cfg -e ANSIBLE_NOCOLOR=false --quiet --name ansible_runner_instance quay.io/quay/mirror-registry-ee:latest ansible-playbook -i root@mirror.testcluster.com, --private-key /runner/env/ssh_key -e "init_user=init init_password=49VmjJGu0bsd7MT5o1fpkvOK82B6ICz3 quay_image=registry.redhat.io/quay/quay-rhel8:v3.8.6 quay_version=v3.8.6 redis_image=registry.redhat.io/rhel8/redis-6:1-92.1669834635 postgres_image=registry.redhat.io/rhel8/postgresql-10:1-203.1669834630 pause_image=registry.access.redhat.com/ubi8/pause:8.7-6 quay_hostname=mirror.testcluster.com:8443 local_install=true quay_root=/opt/quay quay_storage=quay-storage pg_storage=pg-storage" install_mirror_appliance.yml
      Error: initializing source docker://quay.io/quay/mirror-registry-ee:latest: reading manifest latest in quay.io/quay/mirror-registry-ee: unauthorized: access to the requested resource is not authorized

      ~~~

      Please that I'm logged in to quay but still getting this error. I can pull other images from quay but not this one.

              Unassigned Unassigned
              rhn-support-alosingh Alok Singh
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: