Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-37333

On z/VM bootstrap cannot retrieve images from the Red Hat mirror site

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Major Major
    • None
    • 4.16.0
    • Release
    • None
    • Important
    • No
    • False
    • Hide

      None

      Show
      None

      Description of problem:

          It was noted on 7/18 on slack that in order to retrieve images from the mirror site it is now required to use curl -L. The bootstrap node is attempting to get images but is apparently not using the -L flag so it fails.

      Version-Release number of selected component (if applicable):

          4.16.0 and others

      How reproducible:

          Very

      Steps to Reproduce:

          1.Have a z/VM bastion
          2.Attempt to load a cluster
          3.Watch the z/VM console output for the curl fails
      
          

      Actual results:

          13:21:42 Displaying logs from failed units: sysroot.mount                      
      13:21:42 coreos-livepxe-rootfs.service                                         
      13:21:42 Jul 19 13:21:37 systemd[1]: Mounting /sysroot...                      
      13:21:42 Jul 19 13:21:37 mount[1271]: mount: /sysroot: failed to setup loop dev
      13:21:42 Jul 19 13:21:37 systemd[1]: [0;1;39m[0;1;31m[0;1;39msysroot.mount: Mou
      13:21:42 Jul 19 13:21:37 systemd[1]: [0;1;38;5;185m[0;1;39m[0;1;38;5;185msysroo
      13:21:42 Jul 19 13:21:37 systemd[1]: [0;1;31m[0;1;39m[0;1;31mFailed to mount /s
      13:21:42 Jul 19 13:21:36 systemd[1]: Starting Acquire Live PXE rootfs Image... 
      13:21:42 Jul 19 13:21:36 coreos-livepxe-rootfs[1234]: Fetching rootfs image fro
      13:21:42 Jul 19 13:21:37 coreos-livepxe-rootfs[1264]: curl: (22) The requested 
      13:21:42 Jul 19 13:21:37 coreos-livepxe-rootfs[1234]: Couldn't query the server
      13:21:42 Jul 19 13:21:37 coreos-livepxe-rootfs[1234]: coreos.live.rootfs_url=ht
      13:21:42 Jul 19 13:21:37 systemd[1]: [0;1;39m[0;1;31m[0;1;39mcoreos-livepxe-roo
      13:21:42 Jul 19 13:21:37 systemd[1]: [0;1;38;5;185m[0;1;39m[0;1;38;5;185mcoreos
      13:21:42 Jul 19 13:21:37 systemd[1]: [0;1;31m[0;1;39m[0;1;31mFailed to start Ac
      13:21:42 Jul 19 13:21:37 systemd[1]: coreos-livepxe-rootfs.service: Triggering 
      13:21:42 Generating "/run/initramfs/rdsosreport.txt"                           
      13:21:42 Entering emergency mode. Exit the shell to continue.                  
      13:21:42 Type "journalctl" to view system logs.                                
      13:21:42 You might want to save "/run/initramfs/rdsosreport.txt" to a USB stick
      13:21:42 after mounting them and attach it to a bug report.

      Expected results:

          Bootstrap retrieves images from the mirror site

      Additional info:

          This has been working for years and abruptly stopped yesterday after this was posted in slack.
      
      FYI https://redhat-internal.slack.com/archives/CFUGK0K9R/p1721317924448679
      This should affect a lot of our automation. If you previously used curl to download openshift-client without adding -L, it will now fail.mirror.openshift.com has been migrated to deliver bits from a different cloud provider. This should be completely transparent for users, but please let me know if you spot any oddities. cc @ashwin.

       

            jupierce Justin Pierce
            christian.lapolt Christian LaPolt (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated: