Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-7513

OCP installation on GCP fails due to - failed to find and re-link disk

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Duplicate
    • Icon: Undefined Undefined
    • None
    • 4.13
    • Storage / Kubernetes
    • None
    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • None
    • None
    • No
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Description of problem:

      The installation failes because monitoring isn't availalbe:
      Cluster operator monitoring Progressing is True with RollOutInProgress: Rolling out the stack
      
      The prometheus pod is pending:
      openshift-monitoring                              prometheus-k8s-0                                                    0/6    Pending    0         42m
      openshift-monitoring                              prometheus-k8s-1                                                    0/6    Pending    0         36m
      
      It can't start because it's failing to mount:
      
      40m        Warning  FailedMount               pod/prometheus-k8s-1                                         Unable to attach or mount volumes: unmounted volumes=[prometheus-data], unattached volumes=[secret-metrics-client-certs prometheus-k8s-rulefiles-0 secret-kube-etcd-client-certs secret-prometheus-k8s-proxy secret-prometheus-k8s-thanos-sidecar-tls kube-api-access-k6b89 secret-kube-rbac-proxy configmap-kubelet-serving-ca-bundle secret-prometheus-k8s-tls web-config configmap-serving-certs-ca-bundle config tls-assets configmap-metrics-client-ca config-out secret-grpc-tls prometheus-trusted-ca-bundle prometheus-data metrics-client-ca]: timed out waiting for the condition
      
      
      42m        Normal   SuccessfulAttachVolume    pod/prometheus-k8s-0                                         AttachVolume.Attach succeeded for volume "pvc-16d4ef63-71f3-4943-b41c-088d12dc1cc5"
      2m13s      Warning  FailedMount               pod/prometheus-k8s-0                                         MountVolume.MountDevice failed for volume "pvc-16d4ef63-71f3-4943-b41c-088d12dc1cc5" : rpc error: code = Internal desc = Error when getting device path: rpc error: code = Internal desc = error verifying GCE PD ("pvc-16d4ef63-71f3-4943-b41c-088d12dc1cc5") is attached: failed to find and re-link disk pvc-16d4ef63-71f3-4943-b41c-088d12dc1cc5 with udevadm after retrying for 3s: timed out waiting for the condition

       

      Version-Release number of selected component (if applicable):

      4.13

      How reproducible:

      100% [here|http://example.com]

      Steps to Reproduce:

      1. go to: https://github.com/openshift/release/pull/36216
      2. comment /pj-rehearse periodic-ci-openshift-release-master-ci-4.13-e2e-gcp-confidential 

      Actual results:

      Installation fails with the above error

      Expected results:

      Expected installation to complete succesfully

      Additional info:

       

              rhn-engineering-jsafrane Jan Safranek
              ercohen Eran Cohen
              None
              None
              None
              None
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: