Uploaded image for project: 'Project Quay'
  1. Project Quay
  2. PROJQUAY-569

Quay app can't be ready by specifying replicas=3 with Quay Operator deployment

XMLWordPrintable

      Description:
      This is an issue found when using Quay 3.3 RC operator image "quay-operator:v1.1.0-rc1" to deploy Quay ENV, for quay app specifying "replicas: 3" in the QuayEcosystem CR file, the results is Quay app can't be ready status successfully.

      Compared with Quay operator 1.0.2, with using the same quay image "quay:3.2.1-1", this issue was not existed.

      ENV:
      Quay imge: quay.io/quay/quay:3.2.1-1
      Quay Operator: quay-operator:v1.1.0-rc1

      Steps:
      1. Deploy Quay Operator with the following steps.
      Modify the file "deploy/operator.yaml" to replace the image with
      "quay.io/kmullins/quay-operator:v1.1.0-rc1"
      Run the following commands to deploy the Operator to OpenShift:
      $ oc new-project quay-enterprise
      $ oc create -f deploy/crds/redhatcop.redhat.io_quayecosystems_crd.yaml
      $ oc create -f deploy/service_account.yaml
      $ oc create -f deploy/cluster_role.yaml
      $ oc create -f deploy/cluster_role_binding.yaml
      $ oc create -f deploy/role.yaml
      $ oc create -f deploy/role_binding.yaml
      $ oc create -f deploy/operator.yaml
      2. Deploy Quay ENV by running "oc create -f quayecosystem_cr_20200408.yaml"

      Expected Result:
      Quay ENV will be deployed successfully using new Operator.

      Actual Results:

      Quay ENV deployment was failed at deploying quay application, one or two quay POD can't be in ready status within the expected time, then observed all quay containers are restarted again and again.

      The following is the results by using quay-operator:v1.1.0-rc1+the same quay image "quay:3.2.1-1"
      lizhang@lzha-mac deploy % oc get pod
      NAME READY STATUS RESTARTS AGE
      demo-quayecosystem-clair-78f4f6bcff-97ps2 1/1 Running 0 57s
      demo-quayecosystem-clair-postgresql-6bdff9cff5-bjlr8 1/1 Running 0 89s
      demo-quayecosystem-quay-7d4755d658-7q56z 0/1 Running 1 6m6s
      demo-quayecosystem-quay-7d4755d658-n2wfh 1/1 Running 1 6m6s
      demo-quayecosystem-quay-7d4755d658-qvdj5 1/1 Running 1 6m6s
      demo-quayecosystem-quay-config-7fc6968986-z8h4l 1/1 Running 0 6m27s
      demo-quayecosystem-quay-postgresql-6b78596b6b-52zcw 1/1 Running 0 7m13s
      demo-quayecosystem-quay-repomirror-769d54d45-bxf5n 1/1 Running 0 2m15s
      demo-quayecosystem-redis-74ff87d7fc-6sblz 1/1 Running 0 7m53s
      quay-operator-d497d6d45-vxwd8 1/1 Running 0 24h
      lizhang@lzha-mac deploy % oc get pod
      NAME READY STATUS RESTARTS AGE
      demo-quayecosystem-clair-78f4f6bcff-97ps2 1/1 Running 0 3m55s
      demo-quayecosystem-clair-postgresql-6bdff9cff5-bjlr8 1/1 Running 0 4m27s
      demo-quayecosystem-quay-7d4755d658-7q56z 0/1 Running 2 9m4s
      demo-quayecosystem-quay-7d4755d658-n2wfh 0/1 Running 2 9m4s
      demo-quayecosystem-quay-7d4755d658-qvdj5 1/1 Running 2 9m4s
      demo-quayecosystem-quay-config-7fc6968986-z8h4l 1/1 Running 0 9m25s
      demo-quayecosystem-quay-postgresql-6b78596b6b-52zcw 1/1 Running 0 10m
      demo-quayecosystem-quay-repomirror-769d54d45-bxf5n 1/1 Running 0 5m13s
      demo-quayecosystem-redis-74ff87d7fc-6sblz 1/1 Running 0 10m
      quay-operator-d497d6d45-vxwd8 1/1 Running 0 24h
      lizhang@lzha-mac deploy % oc get pod
      NAME READY STATUS RESTARTS AGE
      demo-quayecosystem-clair-78f4f6bcff-97ps2 1/1 Running 0 5m47s
      demo-quayecosystem-clair-postgresql-6bdff9cff5-bjlr8 1/1 Running 0 6m19s
      demo-quayecosystem-quay-7d4755d658-7q56z 0/1 Running 3 10m
      demo-quayecosystem-quay-7d4755d658-n2wfh 0/1 Running 3 10m
      demo-quayecosystem-quay-7d4755d658-qvdj5 0/1 Running 3 10m
      demo-quayecosystem-quay-config-7fc6968986-z8h4l 1/1 Running 0 11m
      demo-quayecosystem-quay-postgresql-6b78596b6b-52zcw 1/1 Running 0 12m
      demo-quayecosystem-quay-repomirror-769d54d45-bxf5n 1/1 Running 0 7m5s
      demo-quayecosystem-redis-74ff87d7fc-6sblz 1/1 Running 0 12m
      quay-operator-d497d6d45-vxwd8 1/1 Running 0 24h
      lizhang@lzha-mac deploy % oc get pod
      NAME READY STATUS RESTARTS AGE
      demo-quayecosystem-clair-78f4f6bcff-97ps2 1/1 Running 0 9m32s
      demo-quayecosystem-clair-postgresql-6bdff9cff5-bjlr8 1/1 Running 0 10m
      demo-quayecosystem-quay-7d4755d658-7q56z 0/1 Running 4 14m
      demo-quayecosystem-quay-7d4755d658-n2wfh 1/1 Running 4 14m
      demo-quayecosystem-quay-7d4755d658-qvdj5 1/1 Running 4 14m
      demo-quayecosystem-quay-config-7fc6968986-z8h4l 1/1 Running 0 15m
      demo-quayecosystem-quay-postgresql-6b78596b6b-52zcw 1/1 Running 0 15m
      demo-quayecosystem-quay-repomirror-769d54d45-bxf5n 1/1 Running 0 10m
      demo-quayecosystem-redis-74ff87d7fc-6sblz 1/1 Running 0 16m
      quay-operator-d497d6d45-vxwd8 1/1 Running 0 24h
      lizhang@lzha-mac deploy % oc get pod
      NAME READY STATUS RESTARTS AGE
      demo-quayecosystem-clair-78f4f6bcff-97ps2 1/1 Running 0 10m
      demo-quayecosystem-clair-postgresql-6bdff9cff5-bjlr8 1/1 Running 0 10m
      demo-quayecosystem-quay-7d4755d658-7q56z 0/1 Running 5 15m
      demo-quayecosystem-quay-7d4755d658-n2wfh 1/1 Running 4 15m
      demo-quayecosystem-quay-7d4755d658-qvdj5 0/1 Running 4 15m
      demo-quayecosystem-quay-config-7fc6968986-z8h4l 1/1 Running 0 15m
      demo-quayecosystem-quay-postgresql-6b78596b6b-52zcw 1/1 Running 0 16m
      demo-quayecosystem-quay-repomirror-769d54d45-bxf5n 1/1 Running 0 11m
      demo-quayecosystem-redis-74ff87d7fc-6sblz 1/1 Running 0 17m
      quay-operator-d497d6d45-vxwd8 1/1 Running 0 24h

      The following is the results by using Quay 1.0.2 operator+the same quay image "quay:3.2.1-1"
      lizhang@lzha-mac deploy % oc get pod
      NAME READY STATUS RESTARTS AGE
      demo-quayecosystem-clair-78f4f6bcff-74s5z 1/1 Running 0 29h
      demo-quayecosystem-clair-postgresql-864fb667d6-mfzcn 1/1 Running 0 29h
      demo-quayecosystem-quay-config-6b6499956d-lpffz 1/1 Running 0 29h
      demo-quayecosystem-quay-f975c6445-4d7x5 1/1 Running 0 93m
      demo-quayecosystem-quay-f975c6445-55hf4 1/1 Running 0 86s
      demo-quayecosystem-quay-f975c6445-7k8ck 1/1 Running 0 94m
      demo-quayecosystem-quay-f975c6445-dpr5w 1/1 Running 0 86s
      demo-quayecosystem-quay-f975c6445-w22tn 1/1 Running 0 94m
      demo-quayecosystem-quay-postgresql-6b78596b6b-rks2b 1/1 Running 0 29h
      demo-quayecosystem-quay-repomirror-769d54d45-g64hb 1/1 Running 0 29h
      demo-quayecosystem-redis-6987ffff78-bkgkw 1/1 Running 0 29h
      elasticsearch-operator-8d7545c64-bdbtz 1/1 Running 0 18h
      quay-operator-664fc7c64d-pbbj8 1/1 Running 0 29h

      OCP ENV:
      https://console-openshift-console.apps.lzha0407.qe.devcluster.openshift.com"
      kubeadmin, password: ZmQG5-EIZXB-o92Sb-Bojag"

      Under quay-enterprise namespaces: Quay 1.0.2 Operator + quay image "quay:3.2.1-1"
      Under quay-enterprise200 namespaces: quay-operator:v1.1.0-rc1 + quay image "quay:3.2.1-1"

      lizhang@lzha-mac deploy % cat quayecosystem_cr_20200408.yaml
      apiVersion: redhatcop.redhat.io/v1alpha1
      kind: QuayEcosystem
      metadata:
      name: demo-quayecosystem
      spec:
      quay:
      imagePullSecretName: redhat-pull-secret
      image: quay.io/quay/quay:3.2.1-1
      keepConfigDeployment: true
      enableRepoMirroring: true
      configSecretName: configapppwd
      replicas: 3
      superuserCredentialsSecretName: superusercredentials
      resources:
      requests:
      memory: "2048Mi"
      cpu: "2000m"
      limits:
      memory: "4096Mi"
      cpu: "4000m"
      database:
      image: registry.access.redhat.com/rhscl/postgresql-96-rhel7:1
      volumeSize: 30Gi
      envVars:

      • name: DEBUGLOG
        value: "true"
        clair:
        enabled: true
        image: quay.io/quay/clair-jwt:v3.2.1-1
        imagePullSecretName: redhat-pull-secret
        updateInterval: "60m"
        database:
        image: registry.access.redhat.com/rhscl/postgresql-96-rhel7:1
        resources:
        requests:
        memory: "2048Mi"
        cpu: "2000m"
        limits:
        memory: "4096Mi"
        cpu: "4000m"
        volumeSize: 30Gi

              kmullins@redhat.com Kurtis Mullins (Inactive)
              lzha1981 luffy zhang
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated:
                Resolved: