Uploaded image for project: 'Project Quay'
  1. Project Quay
  2. PROJQUAY-1213

Quay new pod was failed to start after click "reconfigure quay"

XMLWordPrintable

    • False
    • False
    • Undefined

      Description:

      This is an issue found when use config tool to reconfigure quay, after deployed quay with TNG Operator successfully, open Quay config editor tool, make some changes(add new super users), click button "Reconfigure Quay", found new Quay POD was failed to start, checked  OCP console logs, get error message , see screenshot attached.

      MountVolume.SetUp failed for volume "configvolume" : secret "quaytest-quay-config-secret-2h97tktghg" not found
      

       

      lizhang@lzha-mac Downloads % oc get pod
      NAME                                           READY   STATUS              RESTARTS   AGE
      quay-operator-6d888b6b75-jwxp2                 1/1     Running             0          4h39m
      quaytest-clair-685f79b754-xc8m2                1/1     Running             0          3h15m
      quaytest-clair-postgres-679cb449cc-dn9kg       1/1     Running             1          3h16m
      quaytest-quay-app-5bc949fdc5-cv27l             0/1     ContainerCreating   0          34m
      quaytest-quay-app-c8b878c99-z289t              1/1     Running             0          3h15m
      quaytest-quay-config-editor-6c5bfc49b4-h47sg   0/1     ContainerCreating   0          34m
      quaytest-quay-config-editor-f98fd44b6-ppfkn    1/1     Running             0          3h15m
      quaytest-quay-database-66db4d5c8f-x2zth        1/1     Running             0          34m
      quaytest-quay-mirror-56dccd494d-qc9ff          1/1     Running             0          3h15m
      quaytest-quay-postgres-init-5rsb9              0/1     Completed           0          3h16m
      quaytest-quay-redis-95c8b889c-xcz7q            1/1     Running             0          3h16m
      
      lizhang@lzha-mac Downloads % oc get secret
      NAME                                      TYPE                                  DATA   AGE
      builder-dockercfg-tzkfm                   kubernetes.io/dockercfg               1      4h50m
      builder-token-b2hbq                       kubernetes.io/service-account-token   4      4h50m
      builder-token-dsn98                       kubernetes.io/service-account-token   4      4h50m
      default-dockercfg-c4j7h                   kubernetes.io/dockercfg               1      4h50m
      default-token-fbsg4                       kubernetes.io/service-account-token   4      4h50m
      default-token-zznzn                       kubernetes.io/service-account-token   4      4h50m
      deployer-dockercfg-627g7                  kubernetes.io/dockercfg               1      4h50m
      deployer-token-4kbjz                      kubernetes.io/service-account-token   4      4h50m
      deployer-token-h2tbx                      kubernetes.io/service-account-token   4      4h50m
      quay-operator-dockercfg-ddj2d             kubernetes.io/dockercfg               1      4h40m
      quay-operator-token-gj8mp                 kubernetes.io/service-account-token   4      4h40m
      quay-operator-token-pkkhs                 kubernetes.io/service-account-token   4      4h40m
      quaydemo-config-bundle-bzfnx              Opaque                                1      4h36m
      quaytest-clair-config-secret              Opaque                                1      3h17m
      quaytest-postgres-bootstrap               Opaque                                2      3h17m
      quaytest-quay-config-bundle-xqfnd         Opaque                                4      35m
      quaytest-quay-config-editor-credentials   Opaque                                1      3h17m
      quaytest-quay-config-secret-6cb5fth6hc    Opaque                                3      3h16m
      quaytest-quay-config-secret-7g6f27m9f5    Opaque                                3      3h17m
      quaytest-quay-config-secret-fd9tkftf7h    Opaque                                3      3h17m
      test-config-bundle                        Opaque                                1      3h19m
      
      lizhang@lzha-mac Downloads % oc get route
      NAME                          HOST/PORT                                                                                       PATH   SERVICES                      PORT    TERMINATION            WILDCARD
      quaytest-quay                 quaytest-quay-quay1029.apps.quay-perf-399.perf-testing.devcluster.openshift.com                        quaytest-quay-app             https   passthrough/Redirect   None
      quaytest-quay-config-editor   quaytest-quay-config-editor-quay1029.apps.quay-perf-399.perf-testing.devcluster.openshift.com          quaytest-quay-config-editor   http    edge/Redirect          None
      

      OCP Version: 4.6

      oc version
      Server Version: 4.6.0-0.nightly-2020-10-22-034051
      Kubernetes Version: v1.19.0+d59ce34
      

      Index image:  brew.registry.redhat.io/rh-osbs/iib:23617

      Quay Operator image

      lizhang@lzha-mac quay3.4 % oc get pod quay-operator-6d888b6b75-jwxp2 -o json | jq '.spec.containers[0].image'
      "registry.redhat.io/quay/quay-rhel8-operator@sha256:27db7d61c0f4f7793d0663ca1d5e172790ae3c771cf9242857691e728bd0fa17"
      

      Quay image: 

      lizhang@lzha-mac Downloads % oc get pod quaytest-quay-app-5bc949fdc5-cv27l -o json | jq '.spec.containers[0].image'
      "registry.redhat.io/quay/quay@sha256:4fd2d0a53b37a8811d4ce7573ff50d3485c9a7c35a8787d79b110f37450cc9c5"
      

      Quay CR:

      lizhang@lzha-mac quay3.4 % cat quayregistry.yaml 
      apiVersion: quay.redhat.com/v1
      kind: QuayRegistry
      metadata:
        name: quaytest
      spec:
        configBundleSecret: test-config-bundle
        components:
          - kind: objectstorage
            managed: false
      

       

      Steps:

      1. Open Quay console
      2. Deploy Quay 3.4 TNG Operator
      3. Create Quay CR resource
      4. Check POD status deployed by TNG Operator, all in ready status
      5. Open quay config editor route
      6. Login and add new super user
      7. Click "Validate configuration changes"
      8. Click "Reconfigure Quay"

      Expected Results:

      New Quay and config editor POD are created successfully..

      Actual Results:

      New Quay and config editor POD are failed to be created.

        1. image-2020-11-17-11-04-55-287.png
          349 kB
          luffy zhang
        2. image-2020-11-19-10-43-50-390.png
          117 kB
          luffy zhang
        3. New Quay POD was failed to start.png
          369 kB
          luffy zhang

              rhn-coreos-amerdler Alec Merdler (Inactive)
              lzha1981 luffy zhang
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: