-
Bug
-
Resolution: Done
-
Major
-
quay-v3.3.0
Description:
This is an issue found during deploying Quay with operator, if set TLS termination as edge or none, the results is Quay config app POD was failed to start, see logs section for details.
Attached the CR file for reference.
Expected Results:
Quay config app POD should be running successfully.
Actual Results:
Quay config app POD was failed to start.
lizhang@lzha-mac Quay3.3_operator_testing % oc get pod
NAME READY STATUS RESTARTS AGE
demotlsedge-quayecosystem-quay-config-8f5b484fb-2pr9s 0/1 CrashLoopBackOff 205 11h
demotlsedge-quayecosystem-quay-postgresql-6db88f7f66-5szwf 1/1 Running 0 11h
demotlsedge-quayecosystem-redis-5f6795c4dd-jwcgb 1/1 Running 0 11h
quay-operator-5795b7dd5c-v4mzz 1/1 Running 0 11h
Logs:
lizhang@lzha-mac Quay3.3_operator_testing % cat quayconfig.logs
__ __
/ \ / \ ______ _ _ __ __ __
/ /\ / /\ \ / __ \ | | | | / \ \ \ / /
/ / / / \ \ | | | | | | | | / /\ \ \ /
\ \ \ \ / / | |_| | | |_| | / ____ \ | |
\ \/ \ \/ / _ __/ __/ // _\ |_|
_/ _/ \ __
___\ by Red Hat
Build, Store, and Distribute your Containers
Entering config mode, only copying config-app entrypoints
Creating self-signed certs for quay-config app
Generating a 4096 bit RSA private key
....................................................................++
...................................................................++
unable to write 'random state'
writing new private key to 'quay-config-key.pem'
2020-04-24 01:40:06,263 INFO RPC interface 'supervisor' initialized
2020-04-24 01:40:06,263 CRIT Server 'unix_http_server' running without any HTTP authentication checking
2020-04-24 01:40:06,263 INFO supervisord started with pid 1
2020-04-24 01:40:07,267 INFO spawned: 'stdout' with pid 27
2020-04-24 01:40:07,271 INFO spawned: 'nginx' with pid 28
2020-04-24 01:40:07,276 INFO spawned: 'gunicorn-config' with pid 29
2020/04/24 01:40:07 [alert] 30#0: setpriority(-10) failed (13: Permission denied)
2020/04/24 01:40:07 [alert] 31#0: setpriority(-10) failed (13: Permission denied)
2020-04-24 01:40:08,309 INFO success: stdout entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2020-04-24 01:40:08,310 INFO success: nginx entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2020-04-24 01:40:08,310 INFO success: gunicorn-config entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
nginx stdout | 2020/04/24 01:40:07 [alert] 30#0: setpriority(-10) failed (13: Permission denied)
nginx stdout | 2020/04/24 01:40:07 [alert] 31#0: setpriority(-10) failed (13: Permission denied)
2020-04-24 01:40:09,771 [29] [INFO] [data.registry_model] ===============================
gunicorn-config stdout | 2020-04-24 01:40:09,771 [29] [INFO] [data.registry_model] ===============================
2020-04-24 01:40:09,771 [29] [INFO] [data.registry_model] Using registry model `<data.registry_model.registry_oci_model.OCIModel object at 0x7fadc01dfe10>`
2020-04-24 01:40:09,772 [29] [INFO] [data.registry_model] ===============================
gunicorn-config stdout | 2020-04-24 01:40:09,771 [29] [INFO] [data.registry_model] Using registry model `<data.registry_model.registry_oci_model.OCIModel object at 0x7fadc01dfe10>`
2020-04-24 01:40:09,772 [29] [INFO] [data.registry_model] ===============================
2020-04-24 01:40:09,995 [29] [DEBUG] [config_app.c_app] Configuration is on a kubernetes deployment: True
gunicorn-config stdout | 2020-04-24 01:40:09,995 [29] [DEBUG] [config_app.c_app] Configuration is on a kubernetes deployment: True
2020-04-24 01:40:10,002 [29] [DEBUG] [config_app.c_app] Quay-Config is using the `Default` configuration.
gunicorn-config stdout | 2020-04-24 01:40:10,002 [29] [DEBUG] [config_app.c_app] Quay-Config is using the `Default` configuration.
2020-04-24 01:40:10,251 [29] [DEBUG] [__config__] Starting local gunicorn with 1 workers and gevent worker class
gunicorn-config stdout | 2020-04-24 01:40:10,251 [29] [DEBUG] [__config__] Starting local gunicorn with 1 workers and gevent worker class
2020-04-24 01:41:04,182 WARN received SIGTERM indicating exit request
2020-04-24 01:41:04,182 INFO waiting for nginx, gunicorn-config, stdout to die
/opt/rh/python27/root/usr/lib/python2.7/site-packages/backports/tempfile.py:61: RuntimeWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmpnhuKRC'>
_warnings.warn(warn_message, _ResourceWarning)
gunicorn-config stderr | /opt/rh/python27/root/usr/lib/python2.7/site-packages/backports/tempfile.py:61: RuntimeWarning: Implicitly cleaning up <TemporaryDirectory '/tmp/tmpnhuKRC'>
_warnings.warn(warn_message, _ResourceWarning)
Traceback (most recent call last):
File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/backports/weakref.py", line 143, in _exitfunc
f()
File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/backports/weakref.py", line 67, in _call_
return info.func(*info.args, **(info.kwargs or {}))
File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/backports/tempfile.py", line 60, in _cleanup
_rmtree(name)
File "/opt/rh/python27/root/usr/lib64/python2.7/shutil.py", line 262, in rmtree
onerror(os.listdir, path, sys.exc_info())
File "/opt/rh/python27/root/usr/lib64/python2.7/shutil.py", line 260, in rmtree
names = os.listdir(path)
OSError: [Errno 2] No such file or directory: '/tmp/tmpnhuKRC'
gunicorn-config stderr | Traceback (most recent call last):
File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/backports/weakref.py", line 143, in _exitfunc
gunicorn-config stderr | f()
File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/backports/weakref.py", line 67, in _call_
return info.func(*info.args, **(info.kwargs or {}))
File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/backports/tempfile.py", line 60, in _cleanup
_rmtree(name)
File "/opt/rh/python27/root/usr/lib64/python2.7/shutil.py", line 262, in rmtree
onerror(os.listdir, path, sys.exc_info())
File "/opt/rh/python27/root/usr/lib64/python2.7/shutil.py", line 260, in rmtree
names = os.listdir(path)
OSError: [Errno 2] No such file or directory: '/tmp/tmpnhuKRC'
2020-04-24 01:41:04,843 INFO stopped: gunicorn-config (exit status 0)
2020-04-24 01:41:04,856 INFO stopped: nginx (exit status 0)
2020-04-24 01:41:04,857 INFO stopped: stdout (terminated by SIGTERM)