Uploaded image for project: 'Project Quay'
  1. Project Quay
  2. PROJQUAY-637

Quay CR deployment was stuck with enableStorageReplication as true

XMLWordPrintable

    • Qui-Gon [Quay 184], Red5 [Quay 185]

      Description:
      This is an issue found when deploy Quay CR with latest V3.3 operator, with enableStorageReplication as true, and provide two registryBackends with Azure configurations, the Quay CR deployment was stuck, refer to Quay operator logs.

      Following docs: https://github.com/redhat-cop/quay-operator/blob/master/docs/storage.md#replication

      Steps:
      1. Run "oc create -f quayecosystem_cr_georeplication.yaml"
      2. check POD status

      Expected Results:
      Quay CR deployment should be deployment successfully.

      Actual Results:
      Quay CR deployment was stuck.

      Quay Operator:
      quay.io/quay/quay-rhel8-operator:1.1.0-1

      lizhang@lzha-mac Quay3.3_operator_testing % cat quayecosystem_cr_georeplication.yaml
      apiVersion: redhatcop.redhat.io/v1alpha1
      kind: QuayEcosystem
      metadata:
      name: demogeoreplication-quayecosystem
      spec:
      quay:
      imagePullSecretName: redhat-pull-secret
      image: quay.io/quay/quay:v3.3.0-3
      enableStorageReplication: true
      registryBackends:

      • name: azure-us
        credentialsSecretName: azure-us
        replicateByDefault: true
        azure:
        azure_container: quayus
      • name: azure-uk
        credentialsSecretName: azure-uk
        replicateByDefault: true
        azure:
        azure_container: quayuk
        enableRepoMirroring: true
        database:
        volumeSize: 30Gi
        envVars:
      • name: DEBUGLOG
        value: "true"
        clair:
        enabled: true
        image: quay.io/quay/clair-jwt:v3.3.0-1
        imagePullSecretName: redhat-pull-secret
        updateInterval: "60m"

      Quay Operator logs:

      {"level":"error","ts":1587882720.5416212,"logger":"controller_quayecosystem","msg":"Failed to update QuayEcosystem after setting defaults","error":"Operation cannot be fulfilled on quayecosystems.redhatcop.redhat.io \"demogeoreplication-quayecosystem\": the object has been modified; please apply your changes to the latest version and try again","stacktrace":"github.com/go-logr/zapr.(*zapLogger).Error\n\t/tmp/quay-operator/vendor/github.com/go-logr/zapr/zapr.go:128\ngithub.com/redhat-cop/quay-operator/pkg/controller/quayecosystem.(*ReconcileQuayEcosystem).Reconcile\n\t/tmp/quay-operator/pkg/controller/quayecosystem/quayecosystem_controller.go:161\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/tmp/quay-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:256\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/tmp/quay-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:232\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker\n\t/tmp/quay-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:211\nk8s.io/apimachinery/pkg/util/wait.JitterUntil.func1\n\t/tmp/quay-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:152\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/tmp/quay-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:153\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/tmp/quay-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88"}

              rhn-coreos-amerdler Alec Merdler (Inactive)
              lzha1981 luffy zhang
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated:
                Resolved: