Uploaded image for project: 'Project Quay'
  1. Project Quay
  2. PROJQUAY-3210

Quay 3.6.3 Quay APP POD was Crashed

    XMLWordPrintable

Details

    • Bug
    • Resolution: Done
    • Blocker
    • quay-v3.6.3
    • quay-v3.6.3
    • quay-operator
    • None
    • 0

    Description

      Description:

      This is an issue found when use Quay 3.6.3 Quay Operator to deploy Quay, the result is Quay APP POD was crashed, checked Quay APP POD Logs, get error message "ModuleNotFoundError: No module named 'mock'", see detailed logs  quay363_app_pod.logs 

      Quay 3.6.3 Image: quay-operator-bundle-container-v3.6.3-2

      https://errata.devel.redhat.com/advisory/88291 

      2022-02-14 03:07:48,500 INFO stopped: nginx (exit status 0)
      namespacegcworker stdout | 2022-02-14 03:07:48,500 [71] [INFO] [apscheduler.scheduler] Scheduler has been shut down
      2022-02-14 03:07:48,663 INFO stopped: namespacegcworker (exit status 0)
      gunicorn-web stderr |     Arbiter(self).run()
      gunicorn-web stderr |   File "/usr/local/lib/python3.8/site-packages/gunicorn/arbiter.py", line 58, in __init__
      gunicorn-web stderr |     self.setup(app)
      gunicorn-web stderr |   File "/usr/local/lib/python3.8/site-packages/gunicorn/arbiter.py", line 118, in setup
      gunicorn-web stderr |     self.app.wsgi()
      gunicorn-web stderr |   File "/usr/local/lib/python3.8/site-packages/gunicorn/app/base.py", line 67, in wsgi
      gunicorn-web stderr |     self.callable = self.load()
      gunicorn-web stderr |   File "/usr/local/lib/python3.8/site-packages/gunicorn/app/wsgiapp.py", line 49, in load
      gunicorn-web stderr |     return self.load_wsgiapp()
      gunicorn-web stderr |   File "/usr/local/lib/python3.8/site-packages/gunicorn/app/wsgiapp.py", line 39, in load_wsgiapp
      gunicorn-web stderr |     return util.import_app(self.app_uri)
      gunicorn-web stderr |   File "/usr/local/lib/python3.8/site-packages/gunicorn/util.py", line 358, in import_app
      gunicorn-web stderr |     mod = importlib.import_module(module)
      gunicorn-web stderr |   File "/usr/lib64/python3.8/importlib/__init__.py", line 127, in import_module
      gunicorn-web stderr |     return _bootstrap._gcd_import(name[level:], package, level)
      gunicorn-web stderr |   File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
      gunicorn-web stderr |   File "<frozen importlib._bootstrap>", line 991, in _find_and_load
      gunicorn-web stderr |   File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked
      gunicorn-web stderr |   File "<frozen importlib._bootstrap>", line 671, in _load_unlocked
      gunicorn-web stderr |   File "<frozen importlib._bootstrap_external>", line 783, in exec_module
      gunicorn-web stderr |   File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
      gunicorn-web stderr |   File "/quay-registry/web.py", line 2, in <module>
      gunicorn-web stderr |     from endpoints.api import api_bp
      gunicorn-web stderr |   File "/quay-registry/endpoints/api/__init__.py", line 509, in <module>
      gunicorn-web stderr |     import endpoints.api.organization
      gunicorn-web stderr |   File "/quay-registry/endpoints/api/organization.py", line 37, in <module>
      gunicorn-web stderr |     from endpoints.api.user import User, PrivateRepositories
      gunicorn-web stderr |   File "/quay-registry/endpoints/api/user.py", line 63, in <module>
      gunicorn-web stderr |     from endpoints.common import common_login
      gunicorn-web stderr |   File "/quay-registry/endpoints/common.py", line 9, in <module>
      gunicorn-web stderr |     import endpoints.decorated  # Register the various exceptions via decorators.
      gunicorn-web stderr |   File "/quay-registry/endpoints/decorated.py", line 10, in <module>
      gunicorn-web stderr |     from util.useremails import CannotSendEmailException
      gunicorn-web stderr |   File "/quay-registry/endpoints/decorated.py", line 10, in <module>
      gunicorn-web stderr |     from util.useremails import CannotSendEmailException
      gunicorn-web stderr |   File "/quay-registry/util/useremails.py", line 5, in <module>
      gunicorn-web stderr |     import mock
      gunicorn-web stderr | ModuleNotFoundError: No module named 'mock'
      2022-02-14 03:07:47,472 INFO stopped: queuecleanupworker (exit status 0) 
      oc get pod
      NAME                                               READY   STATUS                  RESTARTS         AGE
      quay-operator.v3.6.3-b8c95b77d-q2zmr               1/1     Running                 0                65m
      quayregistry-clair-app-67fb5b5678-5rzwn            1/1     Running                 0                63m
      quayregistry-clair-app-67fb5b5678-6z8h4            1/1     Running                 0                63m
      quayregistry-clair-postgres-c5db664d6-hgk6n        1/1     Running                 1 (63m ago)      64m
      quayregistry-quay-app-7f5c664f7f-hx2bt             0/1     CrashLoopBackOff        15 (57s ago)     63m
      quayregistry-quay-app-7f5c664f7f-k7h95             0/1     CrashLoopBackOff        15 (72s ago)     63m
      quayregistry-quay-app-upgrade-d25tr                0/1     Completed               0                63m
      quayregistry-quay-config-editor-84ff574f9c-lqbw6   1/1     Running                 0                63m
      quayregistry-quay-database-59769f9795-s5nkr        1/1     Running                 0                64m
      quayregistry-quay-mirror-8649c58784-jrw7m          0/1     Init:Error              17 (5m26s ago)   63m
      quayregistry-quay-mirror-8649c58784-q7l4f          0/1     Init:CrashLoopBackOff   17 (22s ago)     63m
      quayregistry-quay-postgres-init-g8hnm              0/1     Completed               0                63m
      quayregistry-quay-redis-86c47d4494-ps8xq           1/1     Running                 0                64m 
      
      oc get pod quayregistry-quay-app-7f5c664f7f-hx2bt -o json | jq '.spec.containers[0].image'
      "registry.redhat.io/quay/quay-rhel8@sha256:a3dc7c2d01d422fcab8391775f18c38ce3f3a7b22f3cb033b2c0ba0f6d3ed2c5"

      Attachments

        Activity

          People

            fmissi Flavian Missi
            lzha1981 luffy zhang
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: