Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-42290

[OLMV1][TP] Catalogd pod failed to deploy due to catalogserver-cert wasn't created

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Won't Do
    • Icon: Undefined Undefined
    • None
    • 4.18.0
    • OLM
    • Important
    • None
    • Rejected
    • False
    • Hide

      None

      Show
      None

      Description of problem:

      The Catalogd pod failed to deploy because the secret "catalogserver-cert" was not found.

      jiazha-mac:~ jiazha$ omg get clusterversion
      NAME     VERSION  AVAILABLE  PROGRESSING  SINCE  STATUS
      version           False      True         1h0m   Unable to apply 4.18.0-0.nightly-multi-2024-09-22-211746: the cluster operator olm is not available
      jiazha-mac:~ jiazha$ omg get pods 
      NAME                                         READY  STATUS   RESTARTS  AGE
      catalogd-controller-manager-f76d65994-8pd6v  0/2    Pending  0         55m
      jiazha-mac:~ jiazha$ omg get secret 
      NAME                                         TYPE                     DATA  AGE
      builder-dockercfg-6zdcg                      kubernetes.io/dockercfg  1     48m
      catalogd-controller-manager-dockercfg-lr4q5  kubernetes.io/dockercfg  1     48m
      default-dockercfg-rb2gx                      kubernetes.io/dockercfg  1     48m
      deployer-dockercfg-9gmc8                     kubernetes.io/dockercfg  1     48m
      jiazha-mac:~ jiazha$ omg get cm 
      NAME                      DATA  AGE
      kube-root-ca.crt          1     55m
      openshift-service-ca.crt  1     55m
      
      Sep 23 03:49:28.722250 ci-op-qztcbp5l-24dd7-bsmdx-master-0 kubenswrapper[3238]: E0923 03:49:28.722147    3238 pod_workers.go:1298] "Error syncing pod, skipping" err="unmounted volumes=[catalogserver-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-catalogd/catalogd-controller-manager-f76d65994-8pd6v" podUID="c583304f-9cfd-43ec-986f-92869018d7a3"
      22016:Sep 23 03:49:28.755834 ci-op-qztcbp5l-24dd7-bsmdx-master-0 kubenswrapper[3238]: I0923 03:49:28.755791    3238 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-catalogd/catalogd-controller-manager-f76d65994-8pd6v"
      22102:Sep 23 03:50:53.511274 ci-op-qztcbp5l-24dd7-bsmdx-master-0 kubenswrapper[3238]: I0923 03:50:53.511218    3238 reconciler_common.go:220] "operationExecutor.MountVolume started for volume \"catalogserver-certs\" (UniqueName: \"kubernetes.io/secret/c583304f-9cfd-43ec-986f-92869018d7a3-catalogserver-certs\") pod \"catalogd-controller-manager-f76d65994-8pd6v\" (UID: \"c583304f-9cfd-43ec-986f-92869018d7a3\") " pod="openshift-catalogd/catalogd-controller-manager-f76d65994-8pd6v"
      22104:Sep 23 03:50:53.511691 ci-op-qztcbp5l-24dd7-bsmdx-master-0 kubenswrapper[3238]: E0923 03:50:53.511478    3238 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c583304f-9cfd-43ec-986f-92869018d7a3-catalogserver-certs podName:c583304f-9cfd-43ec-986f-92869018d7a3 nodeName:}" failed. No retries permitted until 2024-09-23 03:52:55.511460397 +0000 UTC m=+3550.868837128 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "catalogserver-certs" (UniqueName: "kubernetes.io/secret/c583304f-9cfd-43ec-986f-92869018d7a3-catalogserver-certs") pod "catalogd-controller-manager-f76d65994-8pd6v" (UID: "c583304f-9cfd-43ec-986f-92869018d7a3") : secret "catalogserver-cert" not found
      
      

      Version-Release number of selected component (if applicable):

          

      How reproducible:

          always

      Steps to Reproduce:

          1. Install OCP 4.18
          2. Enable TP.
          3.
          

      Actual results:

      The Catalogd pod was pending.

          jiazha-mac:~ jiazha$ omg get clusterversion
      NAME     VERSION  AVAILABLE  PROGRESSING  SINCE  STATUS
      version           False      True         1h0m   Unable to apply 4.18.0-0.nightly-multi-2024-09-22-211746: the cluster operator olm is not available
      jiazha-mac:~ jiazha$ omg get pods 
      NAME                                         READY  STATUS   RESTARTS  AGE
      catalogd-controller-manager-f76d65994-8pd6v  0/2    Pending  0         55m

      Expected results:

      The Catalogd Pod should be deployed successfully.

      Additional info:

      The must-gather log: https://gcsweb-qe-private-deck-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/qe-private-deck/logs/periodic-ci-openshift-openshift-tests-private-release-4.18-multi-nightly-gcp-ipi-sno-fips-tp-amd-f28-destructive/1838044847257161728/artifacts/gcp-ipi-sno-fips-tp-amd-f28-destructive/gather-must-gather/artifacts/ 

              lmohanty@redhat.com Lalatendu Mohanty
              rhn-support-jiazha Jian Zhang
              Jian Zhang Jian Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated:
                Resolved: