Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-55004

AzureStack: unable to gather serial console logs

XMLWordPrintable

    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • None
    • Moderate
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Description of problem:

          When gathering bootstrap logs from cluster running on azure stack hub, it is unable to collect serial logs with below error:
      
      INFO Pulling Cluster API artifacts                
      INFO Credentials loaded from file "/home/fedora/.azure/osServicePrincipal_ash_qe.json" 
      INFO Pulling VM console logs                      
      DEBUG Attemping to download https://jimaashtest01rljm5sa.blob.mtcazs.wwtatc.com/bootdiagnostics-jimaashte-8e97eff1-c927-4b12-8e93-43ace5d3cfdd/jimaashtest01-rljm5-bootstrap.8e97eff1-c927-4b12-8e93-43ace5d3cfdd.screenshot.bmp 
      DEBUG Attemping to download https://jimaashtest01rljm5sa.blob.mtcazs.wwtatc.com/bootdiagnostics-jimaashte-8e97eff1-c927-4b12-8e93-43ace5d3cfdd/jimaashtest01-rljm5-bootstrap.8e97eff1-c927-4b12-8e93-43ace5d3cfdd.serialconsole.log 
      DEBUG Attemping to download https://jimaashtest01rljm5sa.blob.mtcazs.wwtatc.com/bootdiagnostics-jimaashte-b4598aea-debd-421c-af2e-e309138e6713/jimaashtest01-rljm5-master-0.b4598aea-debd-421c-af2e-e309138e6713.screenshot.bmp 
      DEBUG Attemping to download https://jimaashtest01rljm5sa.blob.mtcazs.wwtatc.com/bootdiagnostics-jimaashte-b4598aea-debd-421c-af2e-e309138e6713/jimaashtest01-rljm5-master-0.b4598aea-debd-421c-af2e-e309138e6713.serialconsole.log 
      DEBUG Attemping to download https://jimaashtest01rljm5sa.blob.mtcazs.wwtatc.com/bootdiagnostics-jimaashte-c4ea8488-c1a6-4d28-9247-318ac5ca1165/jimaashtest01-rljm5-master-1.c4ea8488-c1a6-4d28-9247-318ac5ca1165.screenshot.bmp 
      DEBUG Attemping to download https://jimaashtest01rljm5sa.blob.mtcazs.wwtatc.com/bootdiagnostics-jimaashte-c4ea8488-c1a6-4d28-9247-318ac5ca1165/jimaashtest01-rljm5-master-1.c4ea8488-c1a6-4d28-9247-318ac5ca1165.serialconsole.log 
      DEBUG Attemping to download https://jimaashtest01rljm5sa.blob.mtcazs.wwtatc.com/bootdiagnostics-jimaashte-2a00c798-e4b2-4cd2-8c35-c294b0547f69/jimaashtest01-rljm5-master-2.2a00c798-e4b2-4cd2-8c35-c294b0547f69.screenshot.bmp 
      DEBUG Attemping to download https://jimaashtest01rljm5sa.blob.mtcazs.wwtatc.com/bootdiagnostics-jimaashte-2a00c798-e4b2-4cd2-8c35-c294b0547f69/jimaashtest01-rljm5-master-2.2a00c798-e4b2-4cd2-8c35-c294b0547f69.serialconsole.log 
      INFO Failed to gather VM console logs: [HEAD https://jimaashtest01rljm5sa.blob.mtcazs.wwtatc.com/bootdiagnostics-jimaashte-8e97eff1-c927-4b12-8e93-43ace5d3cfdd/jimaashtest01-rljm5-bootstrap.8e97eff1-c927-4b12-8e93-43ace5d3cfdd.screenshot.bmp 
      INFO -------------------------------------------------------------------------------- 
      INFO RESPONSE 400: 400 Bad Request                
      INFO ERROR CODE UNAVAILABLE                       
      INFO -------------------------------------------------------------------------------- 
      INFO Response contained no body                   
      INFO -------------------------------------------------------------------------------- 
      INFO , HEAD https://jimaashtest01rljm5sa.blob.mtcazs.wwtatc.com/bootdiagnostics-jimaashte-8e97eff1-c927-4b12-8e93-43ace5d3cfdd/jimaashtest01-rljm5-bootstrap.8e97eff1-c927-4b12-8e93-43ace5d3cfdd.serialconsole.log 
      INFO -------------------------------------------------------------------------------- 
      INFO RESPONSE 400: 400 Bad Request                
      INFO ERROR CODE UNAVAILABLE                       
      INFO -------------------------------------------------------------------------------- 
      INFO Response contained no body                   
      INFO -------------------------------------------------------------------------------- 
      INFO , HEAD https://jimaashtest01rljm5sa.blob.mtcazs.wwtatc.com/bootdiagnostics-jimaashte-b4598aea-debd-421c-af2e-e309138e6713/jimaashtest01-rljm5-master-0.b4598aea-debd-421c-af2e-e309138e6713.screenshot.bmp 
      INFO -------------------------------------------------------------------------------- 
      INFO RESPONSE 400: 400 Bad Request                
      INFO ERROR CODE UNAVAILABLE                         

      Version-Release number of selected component (if applicable):

        .4.19 nightly build  

      How reproducible:

         Always 

      Steps to Reproduce:

          1. Install cluster on azure stack hub
          2. Gather bootstrap logs when installing at waiting for bootstrap complete stage
          3.
          

      Actual results:

      serial console logs failed to be downloaded.

      Expected results:

      serial console logs are downloaded successfully.     

      Additional info:

      The issue is unrelated with installation using terrform or CAPI, it can be reproduced even on 4.16.
      
      Checked in storage account on azure stack, just only see screenshot bmp blob, no console log blob there.
      
      # az storage container list --account-name jima15ash7r8hrsa  --account-key AzskhH1DHoZ4IU2Ks+hSIOHu5QYBbGIB9l0X7wVfbaNuLk2eCWtFNgkNNJt1Sm5SIKFYhqFuN6gt516KRw/K/g== -otable
      Name                                                            Lease Status    Last Modified
      --------------------------------------------------------------  --------------  -------------------------
      bootdiagnostics-jima15ash-5a89ae29-b89f-44d1-8eb9-7684ef26fe00  unlocked        2025-04-15T03:51:40+00:00
      bootdiagnostics-jima15ash-c5e7370a-c6ea-456c-9f7b-71345a9351f1  unlocked        2025-04-15T03:52:46+00:00
      bootdiagnostics-jima15ash-e76b9834-378d-4bcd-94d0-d305c6acdb2c  unlocked        2025-04-15T03:52:02+00:00
      bootdiagnostics-jima15ash-ecdb53c9-7d24-4293-992a-e764098784ca  unlocked        2025-04-15T03:52:38+00:00
      ignition                                                        unlocked        2025-04-15T03:50:08+00:00
      
      # az storage blob list --container-name bootdiagnostics-jima15ash-5a89ae29-b89f-44d1-8eb9-7684ef26fe00 --account-name jima15ash7r8hrsa  --account-key AzskhH1DHoZ4IU2Ks+hSIOHu5QYBbGIB9l0X7wVfbaNuLk2eCWtFNgkNNJt1Sm5SIKFYhqFuN6gt516KRw/K/g== -otable
      Name                                                                          Blob Type    Blob Tier    Length    Content Type              Last Modified              Snapshot
      ----------------------------------------------------------------------------  -----------  -----------  --------  ------------------------  -------------------------  ----------
      jima15ash-7r8hr-master-0.5a89ae29-b89f-44d1-8eb9-7684ef26fe00.screenshot.bmp  BlockBlob                 10388     application/octet-stream  2025-04-15T04:09:42+00:00
         

              padillon Patrick Dillon
              jinyunma Jinyun Ma
              None
              None
              Jinyun Ma Jinyun Ma
              None
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: