Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-15381

Upgrade stuck due to wedged rpm-ostreed.service

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Duplicate
    • Icon: Normal Normal
    • None
    • 4.11.z
    • RHCOS
    • None
    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • None
    • Moderate
    • No
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Description of problem:

      Most of the worker nodes were stuck during an upgrade with the error in machine-config daemon:
      
      E0625 05:44:59.138717  113182 writer.go:200] Marking Degraded due to: failed to update OS to quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b2f4d103a9116e5fb0e5237dd7c932360dda0ef77d3d435374692eaa26dad7c : error running rpm-ostree rebase --experimental /run/mco-machine-os-content/os-content-3651922093/srv/repo:1d8a0da9ed9e7c05ad3e2ff5ab6b954746ca38426c9ab9d8bfa5c6e99268413c --custom-origin-url pivot://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9b2f4d103a9116e5fb0e5237dd7c932360dda0ef77d3d435374692eaa26dad7c --custom-origin-description Managed by machine-config-operator: error: The connection is closed
      : exit status 1 

       

      Version-Release number of selected component (if applicable):

       

      How reproducible:

       

      Steps to Reproduce:

      1.
      2.
      3.
      

      Actual results:

       

      Expected results:

       

      Additional info:

      Had to follow the workaround in https://issues.redhat.com/browse/OCPBUGS-13407 to unblock each worker node

              Unassigned Unassigned
              sbasabat.openshift Supreeth Basabattini (Inactive)
              None
              None
              Michael Nguyen Michael Nguyen
              None
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: