Uploaded image for project: 'OpenShift Workloads'
  1. OpenShift Workloads
  2. WRKLDS-593

RFE: 'oc adm must-gather' inspect fallback before removing namespace

XMLWordPrintable

    • Icon: Story Story
    • Resolution: Unresolved
    • Icon: Minor Minor
    • None
    • None

      In a recent CI run, the must-gather failed:

      [must-gather      ] OUT namespace/openshift-must-gather-9dzzn created
      [must-gather      ] OUT clusterrolebinding.rbac.authorization.k8s.io/must-gather-9kdhs created
      [must-gather      ] OUT pod for plug-in image registry.build01.ci.openshift.org/ci-op-4ryqvzt5/stable@sha256:c68fcf3161719f600a803627bca6d0ebf7894bf75282937aebe908a9ef54dedb created
      [must-gather-lxz2x] POD 2022-10-21T10:17:43.213934752Z Gathering data for ns/openshift-cluster-version...
      ...
      [must-gather-lxz2x] POD 2022-10-21T10:18:07.577813555Z Gathering data for ns/openshift-monitoring...
      [must-gather-lxz2x] OUT gather logs unavailable: read tcp 10.131.188.56:50182->3.12.171.103:6443: read: connection reset by peer
      [must-gather-lxz2x] OUT waiting for gather to complete
      [must-gather-lxz2x] OUT gather never finished: pods "must-gather-lxz2x" not found
      [must-gather      ] OUT namespace/openshift-must-gather-9dzzn deleted
      [must-gather      ] OUT clusterrolebinding.rbac.authorization.k8s.io/must-gather-9kdhs deleted
      Gathering data for ns/openshift-config...
      

      And from the build log:

      Running must-gather...
      
      
      Error running must-gather collection:
          gather never finished for pod must-gather-lxz2x: pods "must-gather-lxz2x" not found
      
      Falling back to `oc adm inspect clusteroperators.v1.config.openshift.io` to collect basic cluster information.
      

      The inspection fallback from oc#749 should come before that temporary namespace is deleted, and should include the temporary namespace, so we capture events and such to help debug why the pod failed to launch or if/when something else deleted it.

            Unassigned Unassigned
            trking W. Trevor King
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated: