Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-49333

device unit dev-disk-by\x2dpartlabel-var.device timeout in bootstrap host on Azure MAG

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Undefined Undefined
    • None
    • 4.18, 4.19
    • RHCOS
    • Moderate
    • None
    • 3
    • Integration & Delivery - 267, Integration & Delivery - 268
    • 2
    • False
    • Hide

      None

      Show
      None

      Description of problem:

      QE CI jobs on Azure MAG failed recently on 4.18 and 4.19, bootstrap host failed to be provisioned.
      From bootstrap serial log, got below error:
      
      ^[M^M^[[K[   ^[[0;31m*^[[0;1;31m*^[[0m^[[0;31m*^[[0m] (1 of 2) A start job is running for…artlabel/var (1min 28s / no limit)^M
      ^[M^M^[[K[  ^[[0;31m*^[[0;1;31m*^[[0m^[[0;31m* ^[[0m] (1 of 2) A start job is running for…artlabel/var (1min 28s / no limit)^M
      ^[M^M^[[K[ ^[[0;31m*^[[0;1;31m*^[[0m^[[0;31m*  ^[[0m] (2 of 2) A start job is running for…tion (disks) (1min 37s / no limit)^M
      ^[M^M^[[K[^[[0;31m*^[[0;1;31m*^[[0m^[[0;31m*   ^[[0m] (2 of 2) A start job is running for…tion (disks) (1min 37s / no limit)^M
      ^[M^M^[[K[^[[0;1;31m*^[[0m^[[0;31m*    ^[[0m] (2 of 2) A start job is running for…tion (disks) (1min 38s / no limit)^M
      ^[M^M^[[K[^[[0;1;31m[  100.817660] systemd[1]: dev-disk-by\x2dpartlabel-var.device: Job dev-disk-by\x2dpartlabel-var.device/start timed out.^M
       TIME ^[[0m] Timed out waiting for device ^[[0;1;39m/dev/disk/by-p[  100.824404] systemd[1]: Timed out waiting for device /dev/disk/by-partlabel/var.^M
      artlabel/var^[[0m.^M
      ^[[K[  100.828025] systemd[1]: dev-disk-by\x2dpartlabel-var.device: Job dev-disk-by\x2dpartlabel-var.device/start failed with result 'timeout'.^M
      [  100.835543] ignition[1063]: disks: createFilesystems: op(6): [failed]   waiting for devices [/dev/disk/by-partlabel/var]: device unit dev-disk-by\x2dpartlabel-var.device timeout^M
      [^[[0;1;31mFAILED[  100.843096] ignition[1063]: disks failed^M
      ^[[0m] Failed to start ^[[0;1;39mIgnition (disks)^[[  100.846473] ignition[1063]: Full config:
      
      
      4.18 CI job: https://qe-private-deck-ci.apps.ci.l2s4.p1.openshiftapps.com/view/gs/qe-private-deck/logs/periodic-ci-openshift-openshift-tests-private-release-4.18-amd64-nightly-azure-mag-ipi-fips-f7/1883297210892816384
      4.19 CI job: https://qe-private-deck-ci.apps.ci.l2s4.p1.openshiftapps.com/view/gs/qe-private-deck/logs/periodic-ci-openshift-openshift-tests-private-release-4.19-amd64-nightly-azure-mag-ipi-fips-f7/1881824899970895872
      
      

      Version-Release number of selected component (if applicable):

          4.18/4.19 nightly build

      How reproducible:

          sometimes ( 2 times on 4.18 and 1 time on 4.19 last week)

      Steps to Reproduce:

          1. Install IPI cluster on Azure MAG
          2.
          3.
          

      Actual results:

          Bootstrap host failed to be provisioned.

      Expected results:

          installation succeeded.

      Additional info:

      seems related with https://github.com/openshift/installer/pull/9378/files    

              rh-ee-marmijo Michael Armijo
              jinyunma Jinyun Ma
              Jinyun Ma Jinyun Ma
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

                Created:
                Updated: