__ __ / \ / \ ______ _ _ __ __ __ / /\ / /\ \ / __ \ | | | | / \ \ \ / / / / / / \ \ | | | | | | | | / /\ \ \ / \ \ \ \ / / | |__| | | |__| | / ____ \ | | \ \/ \ \/ / \_ ___/ \____/ /_/ \_\ |_| \__/ \__/ \ \__ \___\ by Red Hat Build, Store, and Distribute your Containers Running all default registry services Running init script '/quay-registry/conf/init/02_get_kube_certs.sh' Running on kubernetes, attempting to retrieve extra certs from secret /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) Found an extra cert %s in config-secret, copying to kube ca dir Found an extra cert %s in config-secret, copying to kube ca dir Running init script '/quay-registry/conf/init/certs_create.sh' Generating a 4096 bit RSA private key ......................................................................................................................................................++ .........................++ unable to write 'random state' writing new private key to 'mitm-key.pem' ----- Running init script '/quay-registry/conf/init/certs_install.sh' Installing extra certificates found in ./conf/kube_extra_certs directory Installing extra cert /quay-registry/conf/stack/extra_ca_certs_quay.crt Installing extra cert /quay-registry/conf/stack/extra_ca_certs_clair.crt Running init script '/quay-registry/conf/init/copy_config_files.sh' Running init script '/quay-registry/conf/init/nginx_conf_create.sh' /quay-registry/conf/init/nginx_conf_create.py:145: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. config = yaml.load(f) Running init script '/quay-registry/conf/init/runmigration.sh' No handlers could be found for logger "util.config.provider.baseprovider" /quay-registry/data/secscan_model/__init__.py:22: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) self._model = V2SecurityScanner(app, instance_keys, storage) No handlers could be found for logger "util.config.provider.baseprovider" /quay-registry/data/secscan_model/__init__.py:22: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) self._model = V2SecurityScanner(app, instance_keys, storage) 07:05:14 INFO [alembic.runtime.migration] Context impl PostgresqlImpl. 07:05:14 INFO [alembic.runtime.migration] Will assume non-transactional DDL. Running init script '/quay-registry/conf/init/supervisord_conf_create.sh' Running init script '/quay-registry/conf/init/zz_boot.sh' No handlers could be found for logger "util.config.provider.baseprovider" /quay-registry/data/secscan_model/__init__.py:22: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) self._model = V2SecurityScanner(app, instance_keys, storage) 2020-07-23 07:05:18,320 INFO RPC interface 'supervisor' initialized 2020-07-23 07:05:18,320 CRIT Server 'unix_http_server' running without any HTTP authentication checking 2020-07-23 07:05:18,321 INFO supervisord started with pid 1 2020-07-23 07:05:19,323 INFO spawned: 'stdout' with pid 97 2020-07-23 07:05:19,326 INFO spawned: 'servicekey' with pid 98 2020-07-23 07:05:19,329 INFO spawned: 'exportactionlogsworker' with pid 99 2020-07-23 07:05:19,333 INFO spawned: 'gunicorn-registry' with pid 100 2020-07-23 07:05:19,336 INFO spawned: 'security_notification_worker' with pid 101 2020-07-23 07:05:19,339 INFO spawned: 'repositorygcworker' with pid 102 2020-07-23 07:05:19,342 INFO spawned: 'queuecleanupworker' with pid 103 2020-07-23 07:05:19,345 INFO spawned: 'gunicorn-web' with pid 104 2020-07-23 07:05:19,359 INFO spawned: 'pushgateway' with pid 105 2020-07-23 07:05:19,362 INFO spawned: 'buildlogsarchiver' with pid 109 2020-07-23 07:05:19,365 INFO spawned: 'gcworker' with pid 110 2020-07-23 07:05:19,410 INFO spawned: 'notificationworker' with pid 113 2020-07-23 07:05:19,413 INFO spawned: 'repositoryactioncounter' with pid 114 2020-07-23 07:05:19,416 INFO spawned: 'teamsyncworker' with pid 115 2020-07-23 07:05:19,470 INFO spawned: 'logrotateworker' with pid 118 2020-07-23 07:05:19,488 INFO spawned: 'blobuploadcleanupworker' with pid 119 2020-07-23 07:05:19,494 INFO spawned: 'nginx' with pid 121 2020-07-23 07:05:19,511 INFO spawned: 'gunicorn-secscan' with pid 122 2020-07-23 07:05:19,517 INFO spawned: 'memcache' with pid 123 2020-07-23 07:05:19,521 INFO spawned: 'chunkcleanupworker' with pid 124 2020-07-23 07:05:19,525 INFO spawned: 'expiredappspecifictokenworker' with pid 126 2020-07-23 07:05:19,533 INFO spawned: 'gunicorn-verbs' with pid 127 2020-07-23 07:05:19,537 INFO spawned: 'securityworker' with pid 128 2020-07-23 07:05:19,545 INFO spawned: 'globalpromstats' with pid 129 2020-07-23 07:05:19,550 INFO spawned: 'builder' with pid 130 2020-07-23 07:05:19,555 INFO spawned: 'dnsmasq' with pid 131 2020-07-23 07:05:19,561 INFO spawned: 'storagereplication' with pid 133 2020-07-23 07:05:19,564 INFO spawned: 'namespacegcworker' with pid 134 2020-07-23 07:05:19,572 INFO spawned: 'jwtproxy' with pid 135 2020-07-23 07:05:20,800 INFO success: stdout entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2020-07-23 07:05:20,801 INFO success: servicekey entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2020-07-23 07:05:20,801 INFO success: exportactionlogsworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2020-07-23 07:05:20,801 INFO success: gunicorn-registry entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2020-07-23 07:05:20,801 INFO success: security_notification_worker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2020-07-23 07:05:20,801 INFO success: repositorygcworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2020-07-23 07:05:20,801 INFO success: queuecleanupworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2020-07-23 07:05:20,801 INFO success: gunicorn-web entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2020-07-23 07:05:20,801 INFO success: pushgateway entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2020-07-23 07:05:20,802 INFO success: buildlogsarchiver entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2020-07-23 07:05:20,802 INFO success: gcworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2020-07-23 07:05:20,802 INFO success: notificationworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2020-07-23 07:05:20,802 INFO success: repositoryactioncounter entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2020-07-23 07:05:20,802 INFO success: teamsyncworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2020-07-23 07:05:20,802 INFO success: logrotateworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2020-07-23 07:05:20,802 INFO success: blobuploadcleanupworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2020-07-23 07:05:20,802 INFO success: nginx entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2020-07-23 07:05:20,802 INFO success: gunicorn-secscan entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2020-07-23 07:05:20,802 INFO success: memcache entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2020-07-23 07:05:20,802 INFO success: chunkcleanupworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2020-07-23 07:05:20,803 INFO success: expiredappspecifictokenworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2020-07-23 07:05:20,803 INFO success: gunicorn-verbs entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2020-07-23 07:05:20,803 INFO success: securityworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2020-07-23 07:05:20,803 INFO success: globalpromstats entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2020-07-23 07:05:20,803 INFO success: builder entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2020-07-23 07:05:20,803 INFO success: dnsmasq entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2020-07-23 07:05:20,803 INFO success: storagereplication entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2020-07-23 07:05:20,803 INFO success: namespacegcworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2020-07-23 07:05:20,803 INFO success: jwtproxy entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) pushgateway stderr | level=info ts=2020-07-23T07:05:19.398Z caller=main.go:81 msg="starting pushgateway" version="(version=1.0.0, branch=HEAD, revision=cc61f46971f5eb7a5be64e80c2ee03857ddbb41a)" level=info ts=2020-07-23T07:05:19.398Z caller=main.go:82 build_context="(go=go1.13.1, user=root@58be538fc30e, date=20191015-19:58:18)" level=info ts=2020-07-23T07:05:19.446Z caller=main.go:142 listen_address=:9091 nginx stdout | 2020/07/23 07:05:19 [alert] 136#0: setpriority(-10) failed (13: Permission denied) nginx stdout | 2020/07/23 07:05:19 [alert] 138#0: setpriority(-10) failed (13: Permission denied) nginx stdout | 2020/07/23 07:05:19 [alert] 137#0: setpriority(-10) failed (13: Permission denied) nginx stdout | 2020/07/23 07:05:19 [alert] 139#0: setpriority(-10) failed (13: Permission denied) jwtproxy stderr | time="2020-07-23T07:05:19Z" level=info msg="No claims verifiers specified, upstream should be configured to verify authorization" time="2020-07-23T07:05:19Z" level=info msg="Starting reverse proxy (Listening on 'unix:/tmp/jwtproxy_secscan.sock')" jwtproxy stderr | time="2020-07-23T07:05:19Z" level=info msg="Starting forward proxy (Listening on ':8081')" dnsmasq stderr | dnsmasq: started, version 2.76 cachesize 150 dnsmasq: compile time options: IPv6 GNU-getopt DBus no-i18n IDN DHCP DHCPv6 no-Lua TFTP no-conntrack ipset auth no-DNSSEC loop-detect inotify dnsmasq: reading /etc/resolv.conf dnsmasq: using nameserver 172.30.0.10#53 dnsmasq stderr | dnsmasq: read /etc/hosts - 7 addresses nginx stdout | 2020/07/23 07:05:28 [crit] 139#0: *1 connect() to unix:/tmp/gunicorn_web.sock failed (2: No such file or directory) while connecting to upstream, client: 10.128.2.1, server: _, request: "GET /health/instance HTTP/2.0", upstream: "http://unix:/tmp/gunicorn_web.sock:/health/instance", host: "10.128.2.21:8443" 2020/07/23 07:05:28 [crit] 139#0: *1 connect() to unix:/tmp/gunicorn_web.sock failed (2: No such file or directory) while connecting to upstream, client: 10.128.2.1, server: _, request: "GET /health/instance HTTP/2.0", upstream: "http://unix:/tmp/gunicorn_web.sock:/quay-registry/static/502.html", host: "10.128.2.21:8443" 10.128.2.1 () - - [23/Jul/2020:07:05:28 +0000] "GET /health/instance HTTP/2.0" 502 173 "-" "kube-probe/1.17+" (0.000 49 0.000 : 0.000) gcworker stderr | No handlers could be found for logger "util.config.provider.baseprovider" expiredappspecifictokenworker stderr | No handlers could be found for logger "util.config.provider.baseprovider" securityworker stderr | No handlers could be found for logger "util.config.provider.baseprovider" teamsyncworker stderr | No handlers could be found for logger "util.config.provider.baseprovider" exportactionlogsworker stderr | No handlers could be found for logger "util.config.provider.baseprovider" gunicorn-secscan stdout | 2020-07-23 07:05:37,325 [122] [INFO] [data.registry_model] =============================== gunicorn-secscan stdout | 2020-07-23 07:05:37,325 [122] [INFO] [data.registry_model] Using registry model `` 2020-07-23 07:05:37,331 [122] [INFO] [data.registry_model] =============================== queuecleanupworker stderr | No handlers could be found for logger "util.config.provider.baseprovider" gunicorn-secscan stdout | 2020-07-23 07:05:37,651 [122] [DEBUG] [app] Loading default config. gunicorn-secscan stdout | 2020-07-23 07:05:37,653 [122] [DEBUG] [util.config.provider.basefileprovider] Applying config file: /quay-registry/conf/stack/config.yaml gunicorn-secscan stdout | 2020-07-23 07:05:37,761 [122] [ERROR] [util.config.provider.baseprovider] Could not validate config schema Traceback (most recent call last): File "/quay-registry/util/config/provider/baseprovider.py", line 46, in import_yaml validate(config_obj, CONFIG_SCHEMA) File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/jsonschema/validators.py", line 899, in validate raise error ValidationError: None is not of type 'string' Failed validating 'type' in schema['properties']['REPO_MIRROR_SERVER_HOSTNAME']: {'description': 'Replaces the SERVER_HOSTNAME as the destination for mirroring. Defaults to unset', 'type': 'string', 'x-example': 'openshift-quay-service'} On instance['REPO_MIRROR_SERVER_HOSTNAME']: None 2020-07-23 07:05:37,763 [122] [DEBUG] [app] Loaded config 2020-07-23 07:05:37,765 [122] [INFO] [util.ipresolver] Loading AWS IP ranges from disk gunicorn-secscan stdout | 2020-07-23 07:05:37,809 [122] [INFO] [util.ipresolver] Building AWS IP ranges globalpromstats stderr | No handlers could be found for logger "util.config.provider.baseprovider" nginx stdout | 2020/07/23 07:05:38 [crit] 139#0: *4 connect() to unix:/tmp/gunicorn_web.sock failed (2: No such file or directory) while connecting to upstream, client: 10.128.2.1, server: _, request: "GET /health/instance HTTP/2.0", upstream: "http://unix:/tmp/gunicorn_web.sock:/health/instance", host: "10.128.2.21:8443" 2020/07/23 07:05:38 [crit] 139#0: *4 connect() to unix:/tmp/gunicorn_web.sock failed (2: No such file or directory) while connecting to upstream, client: 10.128.2.1, server: _, request: "GET /health/instance HTTP/2.0", upstream: "http://unix:/tmp/gunicorn_web.sock:/quay-registry/static/502.html", host: "10.128.2.21:8443" 10.128.2.1 () - - [23/Jul/2020:07:05:38 +0000] "GET /health/instance HTTP/2.0" 502 173 "-" "kube-probe/1.17+" (0.000 49 0.000 : 0.000) buildlogsarchiver stderr | No handlers could be found for logger "util.config.provider.baseprovider" notificationworker stderr | No handlers could be found for logger "util.config.provider.baseprovider" chunkcleanupworker stderr | No handlers could be found for logger "util.config.provider.baseprovider" builder stderr | No handlers could be found for logger "util.config.provider.baseprovider" namespacegcworker stderr | No handlers could be found for logger "util.config.provider.baseprovider" repositorygcworker stderr | No handlers could be found for logger "util.config.provider.baseprovider" teamsyncworker stderr | data/secscan_model/__init__.py:22: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) self._model = V2SecurityScanner(app, instance_keys, storage) blobuploadcleanupworker stderr | No handlers could be found for logger "util.config.provider.baseprovider" teamsyncworker stdout | 2020-07-23 07:05:41,283 [115] [DEBUG] [__main__] Team syncing is disabled; sleeping buildlogsarchiver stderr | data/secscan_model/__init__.py:22: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) self._model = V2SecurityScanner(app, instance_keys, storage) security_notification_worker stderr | No handlers could be found for logger "util.config.provider.baseprovider" logrotateworker stderr | No handlers could be found for logger "util.config.provider.baseprovider" storagereplication stderr | No handlers could be found for logger "util.config.provider.baseprovider" exportactionlogsworker stderr | data/secscan_model/__init__.py:22: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) self._model = V2SecurityScanner(app, instance_keys, storage) buildlogsarchiver stdout | 2020-07-23 07:05:43,362 [109] [DEBUG] [workers.worker] Scheduling worker. buildlogsarchiver stdout | 2020-07-23 07:05:43,364 [109] [INFO] [apscheduler.scheduler] Scheduler started gcworker stderr | data/secscan_model/__init__.py:22: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) self._model = V2SecurityScanner(app, instance_keys, storage) buildlogsarchiver stdout | 2020-07-23 07:05:43,391 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:43,392 [109] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added buildlogsarchiver stdout | 2020-07-23 07:05:43,394 [109] [DEBUG] [workers.worker] First run scheduled for 2020-07-23 07:05:56.395393 gunicorn-web stdout | 2020-07-23 07:05:43,492 [104] [INFO] [data.registry_model] =============================== gunicorn-web stdout | 2020-07-23 07:05:43,492 [104] [INFO] [data.registry_model] Using registry model `` gunicorn-web stdout | 2020-07-23 07:05:43,568 [104] [INFO] [data.registry_model] =============================== buildlogsarchiver stdout | 2020-07-23 07:05:43,600 [109] [INFO] [apscheduler.scheduler] Added job "_archive_redis_buildlogs" to job store "default" buildlogsarchiver stdout | 2020-07-23 07:05:43,607 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:43,607 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:05:56.395393+00:00 (in 12.787550 seconds) gcworker stdout | 2020-07-23 07:05:43,982 [110] [DEBUG] [workers.worker] Scheduling worker. 2020-07-23 07:05:43,983 [110] [INFO] [apscheduler.scheduler] Scheduler started gcworker stdout | 2020-07-23 07:05:43,995 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:43,996 [110] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added gcworker stdout | 2020-07-23 07:05:44,003 [110] [DEBUG] [workers.worker] First run scheduled for 2020-07-23 07:06:10.004697 repositoryactioncounter stderr | No handlers could be found for logger "util.config.provider.baseprovider" gcworker stdout | 2020-07-23 07:05:44,237 [110] [INFO] [apscheduler.scheduler] Added job "_garbage_collection_repos" to job store "default" gcworker stdout | 2020-07-23 07:05:44,240 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:44,240 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:10.004697+00:00 (in 25.763862 seconds) globalpromstats stderr | data/secscan_model/__init__.py:22: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) self._model = V2SecurityScanner(app, instance_keys, storage) globalpromstats stdout | 2020-07-23 07:05:44,697 [129] [DEBUG] [workers.worker] Scheduling worker. 2020-07-23 07:05:44,698 [129] [INFO] [apscheduler.scheduler] Scheduler started servicekey stderr | No handlers could be found for logger "util.config.provider.baseprovider" globalpromstats stdout | 2020-07-23 07:05:44,701 [129] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:44,702 [129] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added globalpromstats stdout | 2020-07-23 07:05:44,704 [129] [DEBUG] [workers.worker] First run scheduled for 2020-07-23 07:52:26.705141 globalpromstats stdout | 2020-07-23 07:05:44,888 [129] [INFO] [apscheduler.scheduler] Added job "_try_report_stats" to job store "default" globalpromstats stdout | 2020-07-23 07:05:44,890 [129] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:44,890 [129] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:52:26.705141+00:00 (in 2801.814873 seconds) securityworker stderr | data/secscan_model/__init__.py:22: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) self._model = V2SecurityScanner(app, instance_keys, storage) securityworker stdout | 2020-07-23 07:05:45,367 [128] [DEBUG] [workers.worker] Scheduling worker. 2020-07-23 07:05:45,368 [128] [INFO] [apscheduler.scheduler] Scheduler started gunicorn-web stdout | 2020-07-23 07:05:45,397 [104] [DEBUG] [app] Loading default config. 2020-07-23 07:05:45,397 [104] [DEBUG] [util.config.provider.basefileprovider] Applying config file: /quay-registry/conf/stack/config.yaml securityworker stdout | 2020-07-23 07:05:45,474 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:45,475 [128] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added 2020-07-23 07:05:45,475 [128] [DEBUG] [workers.worker] First run scheduled for 2020-07-23 07:06:03.476607 gunicorn-web stdout | 2020-07-23 07:05:45,572 [104] [ERROR] [util.config.provider.baseprovider] Could not validate config schema Traceback (most recent call last): File "/quay-registry/util/config/provider/baseprovider.py", line 46, in import_yaml validate(config_obj, CONFIG_SCHEMA) File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/jsonschema/validators.py", line 899, in validate raise error ValidationError: None is not of type 'string' Failed validating 'type' in schema['properties']['REPO_MIRROR_SERVER_HOSTNAME']: {'description': 'Replaces the SERVER_HOSTNAME as the destination for mirroring. Defaults to unset', 'type': 'string', 'x-example': 'openshift-quay-service'} On instance['REPO_MIRROR_SERVER_HOSTNAME']: None 2020-07-23 07:05:45,612 [104] [DEBUG] [app] Loaded config 2020-07-23 07:05:45,614 [104] [INFO] [util.ipresolver] Loading AWS IP ranges from disk securityworker stdout | 2020-07-23 07:05:45,638 [128] [INFO] [apscheduler.scheduler] Added job "_index_in_scanner" to job store "default" securityworker stdout | 2020-07-23 07:05:45,643 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:45,644 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:03.476607+00:00 (in 17.832583 seconds) gunicorn-web stdout | 2020-07-23 07:05:45,699 [104] [INFO] [util.ipresolver] Building AWS IP ranges exportactionlogsworker stdout | 2020-07-23 07:05:45,705 [99] [DEBUG] [__main__] Starting export action logs worker notificationworker stderr | data/secscan_model/__init__.py:22: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) self._model = V2SecurityScanner(app, instance_keys, storage) exportactionlogsworker stdout | 2020-07-23 07:05:45,796 [99] [DEBUG] [workers.worker] Scheduling worker. 2020-07-23 07:05:45,796 [99] [INFO] [apscheduler.scheduler] Scheduler started notificationworker stdout | 2020-07-23 07:05:45,885 [113] [DEBUG] [workers.worker] Scheduling worker. 2020-07-23 07:05:45,886 [113] [INFO] [apscheduler.scheduler] Scheduler started notificationworker stdout | 2020-07-23 07:05:45,909 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:45,910 [113] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added 2020-07-23 07:05:45,910 [113] [DEBUG] [workers.worker] First run scheduled for 2020-07-23 07:05:49.911177 exportactionlogsworker stdout | 2020-07-23 07:05:45,959 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:45,960 [99] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added exportactionlogsworker stdout | 2020-07-23 07:05:45,970 [99] [DEBUG] [workers.worker] First run scheduled for 2020-07-23 07:06:03.971686 notificationworker stdout | 2020-07-23 07:05:45,996 [113] [INFO] [apscheduler.scheduler] Added job "poll_queue" to job store "default" 2020-07-23 07:05:45,997 [113] [DEBUG] [workers.worker] First run scheduled for 2020-07-23 07:10:06.997992 2020-07-23 07:05:45,997 [113] [INFO] [apscheduler.scheduler] Added job "update_queue_metrics" to job store "default" 2020-07-23 07:05:45,997 [113] [DEBUG] [workers.worker] First run scheduled for 2020-07-23 07:06:11.998621 2020-07-23 07:05:45,998 [113] [INFO] [apscheduler.scheduler] Added job "run_watchdog" to job store "default" notificationworker stdout | 2020-07-23 07:05:45,999 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:45,999 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:05:49.911177+00:00 (in 3.911338 seconds) exportactionlogsworker stdout | 2020-07-23 07:05:46,207 [99] [INFO] [apscheduler.scheduler] Added job "poll_queue" to job store "default" exportactionlogsworker stdout | 2020-07-23 07:05:46,208 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:46,209 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:03.971686+00:00 (in 17.762718 seconds) exportactionlogsworker stdout | 2020-07-23 07:05:46,209 [99] [DEBUG] [workers.worker] First run scheduled for 2020-07-23 07:05:57.209762 exportactionlogsworker stdout | 2020-07-23 07:05:46,211 [99] [INFO] [apscheduler.scheduler] Added job "update_queue_metrics" to job store "default" 2020-07-23 07:05:46,211 [99] [DEBUG] [workers.worker] First run scheduled for 2020-07-23 07:06:08.212267 2020-07-23 07:05:46,211 [99] [INFO] [apscheduler.scheduler] Added job "run_watchdog" to job store "default" exportactionlogsworker stdout | 2020-07-23 07:05:46,225 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:46,225 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:05:57.209762+00:00 (in 10.984000 seconds) blobuploadcleanupworker stderr | data/secscan_model/__init__.py:22: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) self._model = V2SecurityScanner(app, instance_keys, storage) blobuploadcleanupworker stdout | 2020-07-23 07:05:47,080 [119] [DEBUG] [workers.worker] Scheduling worker. 2020-07-23 07:05:47,080 [119] [INFO] [apscheduler.scheduler] Scheduler started blobuploadcleanupworker stdout | 2020-07-23 07:05:47,083 [119] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:47,083 [119] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added 2020-07-23 07:05:47,083 [119] [DEBUG] [workers.worker] First run scheduled for 2020-07-23 07:35:32.084729 blobuploadcleanupworker stdout | 2020-07-23 07:05:47,171 [119] [INFO] [apscheduler.scheduler] Added job "_try_cleanup_uploads" to job store "default" blobuploadcleanupworker stdout | 2020-07-23 07:05:47,172 [119] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:47,173 [119] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:35:32.084729+00:00 (in 1784.911643 seconds) queuecleanupworker stderr | data/secscan_model/__init__.py:22: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) self._model = V2SecurityScanner(app, instance_keys, storage) gunicorn-secscan stdout | 2020-07-23 07:05:47,259 [122] [INFO] [util.ipresolver] Finished building AWS IP ranges gunicorn-web stdout | 2020-07-23 07:05:47,436 [104] [INFO] [util.ipresolver] Finished building AWS IP ranges servicekey stderr | data/secscan_model/__init__.py:22: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) self._model = V2SecurityScanner(app, instance_keys, storage) servicekey stdout | 2020-07-23 07:05:47,771 [98] [DEBUG] [workers.worker] Scheduling worker. servicekey stdout | 2020-07-23 07:05:47,774 [98] [INFO] [apscheduler.scheduler] Scheduler started servicekey stdout | 2020-07-23 07:05:47,776 [98] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:47,776 [98] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added servicekey stdout | 2020-07-23 07:05:47,784 [98] [DEBUG] [workers.worker] First run scheduled for 2020-07-23 07:29:06.785757 namespacegcworker stderr | data/secscan_model/__init__.py:22: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) self._model = V2SecurityScanner(app, instance_keys, storage) namespacegcworker stdout | 2020-07-23 07:05:47,879 [134] [DEBUG] [__main__] Starting namespace GC worker namespacegcworker stdout | 2020-07-23 07:05:47,907 [134] [DEBUG] [workers.worker] Scheduling worker. 2020-07-23 07:05:47,908 [134] [INFO] [apscheduler.scheduler] Scheduler started 2020-07-23 07:05:47,908 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:47,908 [134] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added 2020-07-23 07:05:47,909 [134] [DEBUG] [workers.worker] First run scheduled for 2020-07-23 07:06:06.910005 queuecleanupworker stdout | 2020-07-23 07:05:47,940 [103] [DEBUG] [workers.worker] Scheduling worker. 2020-07-23 07:05:47,941 [103] [INFO] [apscheduler.scheduler] Scheduler started queuecleanupworker stdout | 2020-07-23 07:05:47,957 [103] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:47,958 [103] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added queuecleanupworker stdout | 2020-07-23 07:05:47,964 [103] [DEBUG] [workers.worker] First run scheduled for 2020-07-23 08:34:34.965703 namespacegcworker stdout | 2020-07-23 07:05:48,023 [134] [INFO] [apscheduler.scheduler] Added job "poll_queue" to job store "default" 2020-07-23 07:05:48,023 [134] [DEBUG] [workers.worker] First run scheduled for 2020-07-23 07:07:23.024302 2020-07-23 07:05:48,023 [134] [INFO] [apscheduler.scheduler] Added job "update_queue_metrics" to job store "default" 2020-07-23 07:05:48,023 [134] [DEBUG] [workers.worker] First run scheduled for 2020-07-23 07:06:39.024941 2020-07-23 07:05:48,024 [134] [INFO] [apscheduler.scheduler] Added job "run_watchdog" to job store "default" 2020-07-23 07:05:48,024 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:48,024 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:06.910005+00:00 (in 18.885321 seconds) gunicorn-web stdout | 2020-07-23 07:05:48,042 [104] [DEBUG] [data.database] Configuring database 2020-07-23 07:05:48,045 [104] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stderr | /quay-registry/data/secscan_model/__init__.py:22: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) self._model = V2SecurityScanner(app, instance_keys, storage) gunicorn-web stdout | 2020-07-23 07:05:48,052 [104] [INFO] [data.secscan_model] =============================== gunicorn-web stdout | 2020-07-23 07:05:48,052 [104] [INFO] [data.secscan_model] Using split secscan model: `[, ]` 2020-07-23 07:05:48,053 [104] [INFO] [data.secscan_model] v4 whitelist `[]` 2020-07-23 07:05:48,053 [104] [INFO] [data.secscan_model] =============================== gunicorn-web stdout | 2020-07-23 07:05:48,053 [104] [DEBUG] [data.logs_model] Configuring log lodel 2020-07-23 07:05:48,053 [104] [INFO] [data.logs_model] =============================== gunicorn-web stdout | 2020-07-23 07:05:48,053 [104] [INFO] [data.logs_model] Using logs model `` 2020-07-23 07:05:48,054 [104] [INFO] [data.logs_model] =============================== queuecleanupworker stdout | 2020-07-23 07:05:48,081 [103] [INFO] [apscheduler.scheduler] Added job "_cleanup_queue" to job store "default" 2020-07-23 07:05:48,081 [103] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:48,081 [103] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 08:34:34.965703+00:00 (in 5326.884170 seconds) gunicorn-secscan stdout | 2020-07-23 07:05:48,219 [122] [DEBUG] [data.database] Configuring database 2020-07-23 07:05:48,221 [122] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-secscan stderr | /quay-registry/data/secscan_model/__init__.py:22: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) self._model = V2SecurityScanner(app, instance_keys, storage) gunicorn-secscan stdout | 2020-07-23 07:05:48,228 [122] [INFO] [data.secscan_model] =============================== 2020-07-23 07:05:48,228 [122] [INFO] [data.secscan_model] Using split secscan model: `[, ]` 2020-07-23 07:05:48,229 [122] [INFO] [data.secscan_model] v4 whitelist `[]` 2020-07-23 07:05:48,229 [122] [INFO] [data.secscan_model] =============================== 2020-07-23 07:05:48,229 [122] [DEBUG] [data.logs_model] Configuring log lodel 2020-07-23 07:05:48,229 [122] [INFO] [data.logs_model] =============================== gunicorn-secscan stdout | 2020-07-23 07:05:48,229 [122] [INFO] [data.logs_model] Using logs model `` 2020-07-23 07:05:48,230 [122] [INFO] [data.logs_model] =============================== gunicorn-secscan stdout | 2020-07-23 07:05:48,240 [122] [DEBUG] [__config__] Starting secscan gunicorn with 4 workers and gevent worker class nginx stdout | 2020/07/23 07:05:48 [crit] 138#0: *7 connect() to unix:/tmp/gunicorn_web.sock failed (2: No such file or directory) while connecting to upstream, client: 10.128.2.1, server: _, request: "GET /health/instance HTTP/2.0", upstream: "http://unix:/tmp/gunicorn_web.sock:/health/instance", host: "10.128.2.21:8443" 2020/07/23 07:05:48 [crit] 138#0: *7 connect() to unix:/tmp/gunicorn_web.sock failed (2: No such file or directory) while connecting to upstream, client: 10.128.2.1, server: _, request: "GET /health/instance HTTP/2.0", upstream: "http://unix:/tmp/gunicorn_web.sock:/quay-registry/static/502.html", host: "10.128.2.21:8443" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:05:48 +0000] "GET /health/instance HTTP/2.0" 502 173 "-" "kube-probe/1.17+" (0.000 49 0.000 : 0.000) servicekey stdout | 2020-07-23 07:05:48,511 [98] [INFO] [apscheduler.scheduler] Added job "_refresh_service_key" to job store "default" servicekey stdout | 2020-07-23 07:05:48,536 [98] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:48,536 [98] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:29:06.785757+00:00 (in 1398.248882 seconds) expiredappspecifictokenworker stderr | data/secscan_model/__init__.py:22: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) self._model = V2SecurityScanner(app, instance_keys, storage) expiredappspecifictokenworker stdout | 2020-07-23 07:05:48,838 [126] [DEBUG] [__main__] Starting expired app specific token GC worker expiredappspecifictokenworker stdout | 2020-07-23 07:05:48,913 [126] [DEBUG] [__main__] Found expiration window: 1d expiredappspecifictokenworker stdout | 2020-07-23 07:05:48,933 [126] [DEBUG] [workers.worker] Scheduling worker. expiredappspecifictokenworker stdout | 2020-07-23 07:05:48,947 [126] [INFO] [apscheduler.scheduler] Scheduler started chunkcleanupworker stderr | data/secscan_model/__init__.py:22: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) self._model = V2SecurityScanner(app, instance_keys, storage) expiredappspecifictokenworker stdout | 2020-07-23 07:05:48,961 [126] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:48,962 [126] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added 2020-07-23 07:05:48,962 [126] [DEBUG] [workers.worker] First run scheduled for 2020-07-23 07:55:59.963151 chunkcleanupworker stdout | 2020-07-23 07:05:49,164 [124] [DEBUG] [__main__] Swift storage not detected; sleeping expiredappspecifictokenworker stdout | 2020-07-23 07:05:49,285 [126] [INFO] [apscheduler.scheduler] Added job "_gc_expired_tokens" to job store "default" expiredappspecifictokenworker stdout | 2020-07-23 07:05:49,287 [126] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:49,287 [126] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:55:59.963151+00:00 (in 3010.675872 seconds) storagereplication stderr | data/secscan_model/__init__.py:22: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) self._model = V2SecurityScanner(app, instance_keys, storage) repositorygcworker stderr | data/secscan_model/__init__.py:22: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) self._model = V2SecurityScanner(app, instance_keys, storage) repositorygcworker stdout | 2020-07-23 07:05:49,701 [102] [DEBUG] [__main__] Starting repository GC worker storagereplication stdout | 2020-07-23 07:05:49,730 [133] [DEBUG] [__main__] Full storage replication disabled; skipping repositorygcworker stdout | 2020-07-23 07:05:49,731 [102] [DEBUG] [workers.worker] Scheduling worker. 2020-07-23 07:05:49,733 [102] [INFO] [apscheduler.scheduler] Scheduler started repositorygcworker stdout | 2020-07-23 07:05:49,737 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:49,738 [102] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added repositorygcworker stdout | 2020-07-23 07:05:49,738 [102] [DEBUG] [workers.worker] First run scheduled for 2020-07-23 07:06:21.739118 logrotateworker stderr | data/secscan_model/__init__.py:22: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) self._model = V2SecurityScanner(app, instance_keys, storage) repositorygcworker stdout | 2020-07-23 07:05:49,902 [102] [INFO] [apscheduler.scheduler] Added job "poll_queue" to job store "default" 2020-07-23 07:05:49,903 [102] [DEBUG] [workers.worker] First run scheduled for 2020-07-23 07:07:06.904189 repositorygcworker stdout | 2020-07-23 07:05:49,906 [102] [INFO] [apscheduler.scheduler] Added job "update_queue_metrics" to job store "default" 2020-07-23 07:05:49,906 [102] [DEBUG] [workers.worker] First run scheduled for 2020-07-23 07:06:28.907644 2020-07-23 07:05:49,907 [102] [INFO] [apscheduler.scheduler] Added job "run_watchdog" to job store "default" 2020-07-23 07:05:49,907 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:49,907 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:21.739118+00:00 (in 31.831625 seconds) notificationworker stdout | 2020-07-23 07:05:49,919 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:05:49,932 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:05:49 UTC)" (scheduled at 2020-07-23 07:05:49.911177+00:00) 2020-07-23 07:05:49,932 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:05:49,935 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 5, 49, 932578), True, datetime.datetime(2020, 7, 23, 7, 5, 49, 932578), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:05:49,937 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:05:59.911177+00:00 (in 9.991204 seconds) logrotateworker stdout | 2020-07-23 07:05:49,948 [118] [DEBUG] [__main__] Action log rotation worker not enabled; skipping builder stderr | data/secscan_model/__init__.py:22: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) self._model = V2SecurityScanner(app, instance_keys, storage) gunicorn-web stdout | 2020-07-23 07:05:50,120 [104] [DEBUG] [__config__] Starting web gunicorn with 8 workers and gevent worker class repositoryactioncounter stderr | data/secscan_model/__init__.py:22: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) self._model = V2SecurityScanner(app, instance_keys, storage) security_notification_worker stderr | data/secscan_model/__init__.py:22: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) self._model = V2SecurityScanner(app, instance_keys, storage) repositoryactioncounter stdout | 2020-07-23 07:05:50,287 [114] [DEBUG] [workers.worker] Scheduling worker. 2020-07-23 07:05:50,287 [114] [INFO] [apscheduler.scheduler] Scheduler started 2020-07-23 07:05:50,289 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:50,289 [114] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added 2020-07-23 07:05:50,290 [114] [DEBUG] [workers.worker] First run scheduled for 2020-07-23 07:05:58.291018 builder stdout | 2020-07-23 07:05:50,323 [130] [DEBUG] [__main__] Asking to start build manager with lifecycle "enterprise" 2020-07-23 07:05:50,324 [130] [DEBUG] [__main__] Will pass buildman hostname demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com to builders for websocket connection builder stdout | 2020-07-23 07:05:50,324 [130] [DEBUG] [__main__] Starting build manager with lifecycle "enterprise" builder stdout | 2020-07-23 07:05:50,338 [130] [DEBUG] [buildman.server] Initializing the lifecycle manager 2020-07-23 07:05:50,338 [130] [DEBUG] [buildman.server] Registering component with realm registration builder stdout | 2020-07-23 07:05:50,340 [130] [DEBUG] [trollius] Using selector: EpollSelector 2020-07-23 07:05:50,341 [130] [DEBUG] [buildman.server] Initializing all members of the event loop 2020-07-23 07:05:50,341 [130] [DEBUG] [buildman.server] Starting server on port 8787, with controller on port 8686 2020-07-23 07:05:50,341 [130] [DEBUG] [buildman.manager.enterprise] Registering registration method security_notification_worker stdout | 2020-07-23 07:05:50,347 [101] [DEBUG] [workers.worker] Scheduling worker. 2020-07-23 07:05:50,347 [101] [INFO] [apscheduler.scheduler] Scheduler started security_notification_worker stdout | 2020-07-23 07:05:50,350 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:50,350 [101] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added 2020-07-23 07:05:50,350 [101] [DEBUG] [workers.worker] First run scheduled for 2020-07-23 07:06:00.351857 builder stdout | 2020-07-23 07:05:50,379 [130] [DEBUG] [buildman.server] Initializing queue metrics updater 2020-07-23 07:05:50,379 [130] [DEBUG] [buildman.server] Writing metrics security_notification_worker stdout | 2020-07-23 07:05:50,444 [101] [INFO] [apscheduler.scheduler] Added job "poll_queue" to job store "default" 2020-07-23 07:05:50,445 [101] [DEBUG] [workers.worker] First run scheduled for 2020-07-23 07:09:50.446184 2020-07-23 07:05:50,445 [101] [INFO] [apscheduler.scheduler] Added job "update_queue_metrics" to job store "default" 2020-07-23 07:05:50,445 [101] [DEBUG] [workers.worker] First run scheduled for 2020-07-23 07:05:52.446816 2020-07-23 07:05:50,446 [101] [INFO] [apscheduler.scheduler] Added job "run_watchdog" to job store "default" repositoryactioncounter stdout | 2020-07-23 07:05:50,446 [114] [INFO] [apscheduler.scheduler] Added job "wrapper" to job store "default" security_notification_worker stdout | 2020-07-23 07:05:50,448 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:50,448 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:05:52.446816+00:00 (in 1.998506 seconds) repositoryactioncounter stdout | 2020-07-23 07:05:50,448 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:05:50,448 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:05:58.291018+00:00 (in 7.842394 seconds) builder stdout | 2020-07-23 07:05:50,449 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds 2020-07-23 07:05:50,449 [130] [DEBUG] [buildman.server] Initializing work checker 2020-07-23 07:05:50,449 [130] [DEBUG] [data.database] Disconnecting from database. gunicorn-verbs stdout | 2020-07-23 07:05:51,993 [127] [INFO] [data.registry_model] =============================== gunicorn-verbs stdout | 2020-07-23 07:05:51,993 [127] [INFO] [data.registry_model] Using registry model `` 2020-07-23 07:05:51,994 [127] [INFO] [data.registry_model] =============================== gunicorn-registry stdout | 2020-07-23 07:05:52,033 [100] [INFO] [data.registry_model] =============================== gunicorn-registry stdout | 2020-07-23 07:05:52,033 [100] [INFO] [data.registry_model] Using registry model `` 2020-07-23 07:05:52,034 [100] [INFO] [data.registry_model] =============================== gunicorn-verbs stdout | 2020-07-23 07:05:52,228 [127] [DEBUG] [app] Loading default config. gunicorn-verbs stdout | 2020-07-23 07:05:52,229 [127] [DEBUG] [util.config.provider.basefileprovider] Applying config file: /quay-registry/conf/stack/config.yaml gunicorn-verbs stdout | 2020-07-23 07:05:52,263 [127] [ERROR] [util.config.provider.baseprovider] Could not validate config schema Traceback (most recent call last): File "/quay-registry/util/config/provider/baseprovider.py", line 46, in import_yaml validate(config_obj, CONFIG_SCHEMA) File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/jsonschema/validators.py", line 899, in validate raise error ValidationError: None is not of type 'string' Failed validating 'type' in schema['properties']['REPO_MIRROR_SERVER_HOSTNAME']: {'description': 'Replaces the SERVER_HOSTNAME as the destination for mirroring. Defaults to unset', 'type': 'string', 'x-example': 'openshift-quay-service'} On instance['REPO_MIRROR_SERVER_HOSTNAME']: None gunicorn-verbs stdout | 2020-07-23 07:05:52,265 [127] [DEBUG] [app] Loaded config gunicorn-verbs stdout | 2020-07-23 07:05:52,267 [127] [INFO] [util.ipresolver] Loading AWS IP ranges from disk gunicorn-registry stdout | 2020-07-23 07:05:52,274 [100] [DEBUG] [app] Loading default config. gunicorn-registry stdout | 2020-07-23 07:05:52,274 [100] [DEBUG] [util.config.provider.basefileprovider] Applying config file: /quay-registry/conf/stack/config.yaml gunicorn-verbs stdout | 2020-07-23 07:05:52,284 [127] [INFO] [util.ipresolver] Building AWS IP ranges gunicorn-registry stdout | 2020-07-23 07:05:52,306 [100] [ERROR] [util.config.provider.baseprovider] Could not validate config schema Traceback (most recent call last): File "/quay-registry/util/config/provider/baseprovider.py", line 46, in import_yaml validate(config_obj, CONFIG_SCHEMA) File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/jsonschema/validators.py", line 899, in validate raise error ValidationError: None is not of type 'string' Failed validating 'type' in schema['properties']['REPO_MIRROR_SERVER_HOSTNAME']: {'description': 'Replaces the SERVER_HOSTNAME as the destination for mirroring. Defaults to unset', 'type': 'string', 'x-example': 'openshift-quay-service'} On instance['REPO_MIRROR_SERVER_HOSTNAME']: None gunicorn-registry stdout | 2020-07-23 07:05:52,307 [100] [DEBUG] [app] Loaded config gunicorn-registry stdout | 2020-07-23 07:05:52,309 [100] [INFO] [util.ipresolver] Loading AWS IP ranges from disk gunicorn-registry stdout | 2020-07-23 07:05:52,326 [100] [INFO] [util.ipresolver] Building AWS IP ranges security_notification_worker stdout | 2020-07-23 07:05:52,447 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:05:52,448 [101] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:05:52 UTC)" (scheduled at 2020-07-23 07:05:52.446816+00:00) 2020-07-23 07:05:52,448 [101] [DEBUG] [workers.queueworker] Running watchdog. security_notification_worker stdout | 2020-07-23 07:05:52,448 [101] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:05:52 UTC)" executed successfully 2020-07-23 07:05:52,449 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:00.351857+00:00 (in 7.904370 seconds) gunicorn-verbs stdout | 2020-07-23 07:05:52,861 [127] [INFO] [util.ipresolver] Finished building AWS IP ranges gunicorn-registry stdout | 2020-07-23 07:05:52,908 [100] [INFO] [util.ipresolver] Finished building AWS IP ranges gunicorn-verbs stdout | 2020-07-23 07:05:52,999 [127] [DEBUG] [data.database] Configuring database gunicorn-verbs stdout | 2020-07-23 07:05:53,000 [127] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-verbs stderr | /quay-registry/data/secscan_model/__init__.py:22: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) self._model = V2SecurityScanner(app, instance_keys, storage) gunicorn-verbs stdout | 2020-07-23 07:05:53,005 [127] [INFO] [data.secscan_model] =============================== gunicorn-verbs stdout | 2020-07-23 07:05:53,005 [127] [INFO] [data.secscan_model] Using split secscan model: `[, ]` 2020-07-23 07:05:53,005 [127] [INFO] [data.secscan_model] v4 whitelist `[]` 2020-07-23 07:05:53,006 [127] [INFO] [data.secscan_model] =============================== 2020-07-23 07:05:53,006 [127] [DEBUG] [data.logs_model] Configuring log lodel 2020-07-23 07:05:53,006 [127] [INFO] [data.logs_model] =============================== gunicorn-verbs stdout | 2020-07-23 07:05:53,006 [127] [INFO] [data.logs_model] Using logs model `` 2020-07-23 07:05:53,006 [127] [INFO] [data.logs_model] =============================== gunicorn-verbs stdout | 2020-07-23 07:05:53,075 [127] [DEBUG] [__config__] Starting verbs gunicorn with 8 workers and sync worker class gunicorn-registry stdout | 2020-07-23 07:05:53,129 [100] [DEBUG] [data.database] Configuring database gunicorn-registry stdout | 2020-07-23 07:05:53,130 [100] [INFO] [data.database] Connection pooling enabled for postgresql; stale timeout: None; max connection count: None gunicorn-registry stderr | /quay-registry/data/secscan_model/__init__.py:22: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) self._model = V2SecurityScanner(app, instance_keys, storage) gunicorn-registry stdout | 2020-07-23 07:05:53,136 [100] [INFO] [data.secscan_model] =============================== gunicorn-registry stdout | 2020-07-23 07:05:53,136 [100] [INFO] [data.secscan_model] Using split secscan model: `[, ]` 2020-07-23 07:05:53,137 [100] [INFO] [data.secscan_model] v4 whitelist `[]` 2020-07-23 07:05:53,137 [100] [INFO] [data.secscan_model] =============================== 2020-07-23 07:05:53,137 [100] [DEBUG] [data.logs_model] Configuring log lodel gunicorn-registry stdout | 2020-07-23 07:05:53,137 [100] [INFO] [data.logs_model] =============================== 2020-07-23 07:05:53,137 [100] [INFO] [data.logs_model] Using logs model `` 2020-07-23 07:05:53,138 [100] [INFO] [data.logs_model] =============================== gunicorn-registry stdout | 2020-07-23 07:05:53,376 [100] [DEBUG] [__config__] Starting registry gunicorn with 16 workers and gevent worker class notificationworker stdout | 2020-07-23 07:05:54,949 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:05:54,949 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:05:54,949 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:05:59 UTC)" executed successfully buildlogsarchiver stdout | 2020-07-23 07:05:56,395 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:05:56,396 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:05:56 UTC)" (scheduled at 2020-07-23 07:05:56.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:05:56,398 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 5, 56, 396858), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:05:56,399 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:26.395393+00:00 (in 29.999378 seconds) buildlogsarchiver stdout | 2020-07-23 07:05:56,408 [109] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2020-07-23 07:05:56,408 [109] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:05:56,408 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:06:26 UTC)" executed successfully exportactionlogsworker stdout | 2020-07-23 07:05:57,210 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:05:57,211 [99] [INFO] [apscheduler.executors.default] Running job "update_queue_metrics (trigger: interval[0:05:00], next run at: 2020-07-23 07:05:57 UTC)" (scheduled at 2020-07-23 07:05:57.209762+00:00) exportactionlogsworker stdout | 2020-07-23 07:05:57,213 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:03.971686+00:00 (in 6.761325 seconds) exportactionlogsworker stdout | 2020-07-23 07:05:57,214 [99] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2020, 7, 23, 7, 5, 57, 211841), u'exportactionlogs/%']) exportactionlogsworker stdout | 2020-07-23 07:05:57,223 [99] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2020, 7, 23, 7, 5, 57, 211841), True, datetime.datetime(2020, 7, 23, 7, 5, 57, 211841), 0, u'exportactionlogs/%']) exportactionlogsworker stdout | 2020-07-23 07:05:57,226 [99] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2020, 7, 23, 7, 5, 57, 211841), True, datetime.datetime(2020, 7, 23, 7, 5, 57, 211841), 0, u'exportactionlogs/%', False, datetime.datetime(2020, 7, 23, 7, 5, 57, 211841), u'exportactionlogs/%']) exportactionlogsworker stdout | 2020-07-23 07:05:57,228 [99] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2020-07-23 07:05:57,228 [99] [INFO] [apscheduler.executors.default] Job "update_queue_metrics (trigger: interval[0:05:00], next run at: 2020-07-23 07:10:57 UTC)" executed successfully repositoryactioncounter stdout | 2020-07-23 07:05:58,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:05:58,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:05:58 UTC)" (scheduled at 2020-07-23 07:05:58.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:05:58,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:05:58,296 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:08.291018+00:00 (in 9.999355 seconds) repositoryactioncounter stdout | 2020-07-23 07:05:58,304 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:05:58,305 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:05:58,305 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:06:08 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:05:58,388 [438] [DEBUG] [app] Starting request: urn:request:54869f4f-6234-4d40-b997-1742fba92fb6 (/health/instance) gunicorn-web stdout | 2020-07-23 07:05:58,397 [438] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): localhost:8443 gunicorn-web stdout | 2020-07-23 07:05:58,410 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:05:58,417 [463] [DEBUG] [app] Starting request: urn:request:1763d468-0ae7-4620-8622-a37d01fcbe38 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:05:58,421 [463] [DEBUG] [app] Ending request: urn:request:1763d468-0ae7-4620-8622-a37d01fcbe38 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:05:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.011 162 0.011) gunicorn-registry stdout | 2020-07-23 07:05:58,422 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:05:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:05:58,423 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:05:58,426 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:05:58,434 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:05:58,442 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:05:58,447 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:05:58,449 [438] [DEBUG] [app] Starting request: urn:request:8c3c0ea1-8780-4915-954c-805297153810 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:05:58,451 [438] [DEBUG] [app] Ending request: urn:request:8c3c0ea1-8780-4915-954c-805297153810 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:05:58,452 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:05:58 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:05:58 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.005 159 0.005) gunicorn-web stdout | 2020-07-23 07:05:58,453 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:05:58,456 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:05:58 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:05:58,457 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:05:58,460 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:05:58 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:05:58,462 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:05:58,465 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2020, 7, 23, 7, 5, 58, 463895), None, u'quay', u'quay', datetime.datetime(2020, 7, 23, 7, 5, 58, 463982), u'quay', None, datetime.datetime(2020, 7, 22, 7, 5, 58, 464015), datetime.datetime(2020, 7, 16, 7, 5, 58, 464052), None]) gunicorn-web stdout | 2020-07-23 07:05:58,478 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:05:58,483 [466] [DEBUG] [app] Starting request: urn:request:9e98497e-9575-473b-bb32-4b1fd95056a1 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:05:58,488 [466] [DEBUG] [app] Ending request: urn:request:9e98497e-9575-473b-bb32-4b1fd95056a1 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:05:58 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.010 162 0.010) gunicorn-verbs stdout | 2020-07-23 07:05:58,489 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:05:58 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:05:58,489 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:05:58,492 [438] [DEBUG] [app] Ending request: urn:request:54869f4f-6234-4d40-b997-1742fba92fb6 (/health/instance) gunicorn-web stdout | 2020-07-23 07:05:58,492 [438] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:05:58 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.112 49 0.112) gunicorn-web stdout | 2020-07-23 07:05:58,493 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:05:58 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" notificationworker stdout | 2020-07-23 07:05:59,928 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:05:59,929 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:09.911177+00:00 (in 9.982121 seconds) 2020-07-23 07:05:59,929 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:06:09 UTC)" (scheduled at 2020-07-23 07:05:59.911177+00:00) 2020-07-23 07:05:59,930 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:05:59,932 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 5, 59, 930133), True, datetime.datetime(2020, 7, 23, 7, 5, 59, 930133), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:05:59,941 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:05:59,941 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:05:59,941 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:06:09 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:06:00,354 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:06:00,355 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:30.351857+00:00 (in 29.997143 seconds) 2020-07-23 07:06:00,355 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:06:30 UTC)" (scheduled at 2020-07-23 07:06:00.351857+00:00) 2020-07-23 07:06:00,355 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:06:00,358 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 6, 0, 355733), True, datetime.datetime(2020, 7, 23, 7, 6, 0, 355733), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:06:00,368 [101] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:06:00,368 [101] [DEBUG] [data.database] Disconnecting from database. security_notification_worker stdout | 2020-07-23 07:06:00,368 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:06:30 UTC)" executed successfully builder stdout | 2020-07-23 07:06:00,458 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:06:00,471 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:06:00,471 [130] [DEBUG] [data.database] Disconnecting from database. securityworker stdout | 2020-07-23 07:06:03,476 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run securityworker stdout | 2020-07-23 07:06:03,478 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:06:03 UTC)" (scheduled at 2020-07-23 07:06:03.476607+00:00) securityworker stdout | 2020-07-23 07:06:03,479 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:33.476607+00:00 (in 29.999489 seconds) securityworker stdout | 2020-07-23 07:06:03,478 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:06:33 UTC)" executed successfully exportactionlogsworker stdout | 2020-07-23 07:06:03,975 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:06:03,976 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:08.212267+00:00 (in 4.236573 seconds) 2020-07-23 07:06:03,976 [99] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:07:03 UTC)" (scheduled at 2020-07-23 07:06:03.971686+00:00) 2020-07-23 07:06:03,976 [99] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2020-07-23 07:06:03,978 [99] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 6, 3, 976634), True, datetime.datetime(2020, 7, 23, 7, 6, 3, 976634), 0, u'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2020-07-23 07:06:03,986 [99] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2020-07-23 07:06:03,986 [99] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:06:03,987 [99] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:07:03 UTC)" executed successfully gcworker stdout | 2020-07-23 07:06:04,420 [110] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'gcworker.py', 'pid': '110'} expiredappspecifictokenworker stdout | 2020-07-23 07:06:04,783 [126] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '126'} securityworker stdout | 2020-07-23 07:06:05,426 [128] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'securityworker.py', 'pid': '128'} teamsyncworker stdout | 2020-07-23 07:06:05,772 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'teamsyncworker.py', 'pid': '115'} namespacegcworker stdout | 2020-07-23 07:06:06,910 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:06:06,911 [134] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:06:06 UTC)" (scheduled at 2020-07-23 07:06:06.910005+00:00) 2020-07-23 07:06:06,911 [134] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2020-07-23 07:06:06,913 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:39.024941+00:00 (in 32.114341 seconds) namespacegcworker stdout | 2020-07-23 07:06:06,915 [134] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 6, 6, 911648), True, datetime.datetime(2020, 7, 23, 7, 6, 6, 911648), 0, u'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2020-07-23 07:06:06,925 [134] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:06:06,926 [134] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:06:06,926 [134] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:07:06 UTC)" executed successfully exportactionlogsworker stdout | 2020-07-23 07:06:07,175 [99] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'exportactionlogsworker.py', 'pid': '99'} queuecleanupworker stdout | 2020-07-23 07:06:07,590 [103] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'queuecleanupworker.py', 'pid': '103'} gunicorn-secscan stdout | 2020-07-23 07:06:07,790 [413] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '413'} 2020-07-23 07:06:07,790 [412] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '412'} gunicorn-secscan stdout | 2020-07-23 07:06:07,795 [122] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '122'} gunicorn-secscan stdout | 2020-07-23 07:06:07,796 [414] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '414'} gunicorn-secscan stdout | 2020-07-23 07:06:07,797 [411] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '411'} exportactionlogsworker stdout | 2020-07-23 07:06:08,213 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:06:08,213 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:03.971686+00:00 (in 55.758466 seconds) 2020-07-23 07:06:08,213 [99] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:07:08 UTC)" (scheduled at 2020-07-23 07:06:08.212267+00:00) 2020-07-23 07:06:08,214 [99] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:06:08,214 [99] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:07:08 UTC)" executed successfully repositoryactioncounter stdout | 2020-07-23 07:06:08,295 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:06:08,296 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:18.291018+00:00 (in 9.994916 seconds) 2020-07-23 07:06:08,296 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:06:18 UTC)" (scheduled at 2020-07-23 07:06:08.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:06:08,298 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:06:08,306 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:06:08,306 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:06:08,306 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:06:18 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:06:08,389 [435] [DEBUG] [app] Starting request: urn:request:12bdff45-7260-4597-b7f8-af46a3be2212 (/health/instance) gunicorn-web stdout | 2020-07-23 07:06:08,399 [435] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): localhost:8443 gunicorn-web stdout | 2020-07-23 07:06:08,412 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:06:08,419 [480] [DEBUG] [app] Starting request: urn:request:41671166-d113-482c-97c5-c9f5ccebd470 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:06:08,423 [480] [DEBUG] [app] Ending request: urn:request:41671166-d113-482c-97c5-c9f5ccebd470 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:08 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.012 162 0.012) gunicorn-web stdout | 2020-07-23 07:06:08,426 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-registry stdout | 2020-07-23 07:06:08,425 [480] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:06:08 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:06:08,429 [435] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:06:08,439 [435] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) globalpromstats stdout | 2020-07-23 07:06:08,441 [129] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'globalpromstats.py', 'pid': '129'} gunicorn-web stdout | 2020-07-23 07:06:08,447 [435] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:06:08,452 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:06:08,454 [435] [DEBUG] [app] Starting request: urn:request:6ce6e0a5-51f0-41a5-8fe1-0e79a8ce3270 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:06:08,456 [435] [DEBUG] [app] Ending request: urn:request:6ce6e0a5-51f0-41a5-8fe1-0e79a8ce3270 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:08 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.005 159 0.005) gunicorn-web stdout | 2020-07-23 07:06:08,457 [435] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:06:08 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:06:08,458 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:06:08,462 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:06:08,463 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:08 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:06:08,466 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:08 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:06:08,468 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:06:08,471 [435] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2020, 7, 23, 7, 6, 8, 470212), None, u'quay', u'quay', datetime.datetime(2020, 7, 23, 7, 6, 8, 470269), u'quay', None, datetime.datetime(2020, 7, 22, 7, 6, 8, 470292), datetime.datetime(2020, 7, 16, 7, 6, 8, 470314), None]) gunicorn-web stdout | 2020-07-23 07:06:08,484 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:06:08,486 [466] [DEBUG] [app] Starting request: urn:request:b243ac02-3987-4765-99d3-9071c2879ef1 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:06:08,487 [466] [DEBUG] [app] Ending request: urn:request:b243ac02-3987-4765-99d3-9071c2879ef1 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:08 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-verbs stdout | 2020-07-23 07:06:08,488 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:06:08 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:06:08,488 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:06:08,491 [435] [DEBUG] [app] Ending request: urn:request:12bdff45-7260-4597-b7f8-af46a3be2212 (/health/instance) 2020-07-23 07:06:08,491 [435] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:06:08,492 [435] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:06:08 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:06:08 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.111 49 0.111) buildlogsarchiver stdout | 2020-07-23 07:06:08,790 [109] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'buildlogsarchiver.py', 'pid': '109'} notificationworker stdout | 2020-07-23 07:06:09,075 [113] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'notificationworker.py', 'pid': '113'} chunkcleanupworker stdout | 2020-07-23 07:06:09,232 [124] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'chunkcleanupworker.py', 'pid': '124'} notificationworker stdout | 2020-07-23 07:06:09,912 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:06:09,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:06:19 UTC)" (scheduled at 2020-07-23 07:06:09.911177+00:00) 2020-07-23 07:06:09,913 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:11.998621+00:00 (in 2.086279 seconds) 2020-07-23 07:06:09,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:06:09,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 6, 9, 913606), True, datetime.datetime(2020, 7, 23, 7, 6, 9, 913606), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:06:09,924 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:06:09,924 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:06:09,924 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:06:19 UTC)" executed successfully gcworker stdout | 2020-07-23 07:06:10,005 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2020-07-23 07:06:10,005 [110] [INFO] [apscheduler.executors.default] Running job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:06:10 UTC)" (scheduled at 2020-07-23 07:06:10.004697+00:00) gcworker stdout | 2020-07-23 07:06:10,007 [110] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."removed_tag_expiration_s" FROM "user" AS "t1" LIMIT %s', [100]) gcworker stdout | 2020-07-23 07:06:10,007 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:40.004697+00:00 (in 29.999437 seconds) gcworker stdout | 2020-07-23 07:06:10,016 [110] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1594278370014, 1209600, 500, 1, 0]) gcworker stdout | 2020-07-23 07:06:10,021 [110] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2020-07-23 07:06:10,021 [110] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:06:10,021 [110] [INFO] [apscheduler.executors.default] Job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:06:40 UTC)" executed successfully builder stdout | 2020-07-23 07:06:10,437 [130] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'builder.py', 'pid': '130'} builder stdout | 2020-07-23 07:06:10,481 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:06:10,495 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:06:10,495 [130] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2020-07-23 07:06:10,736 [134] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'namespacegcworker.py', 'pid': '134'} repositorygcworker stdout | 2020-07-23 07:06:10,742 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositorygcworker.py', 'pid': '102'} blobuploadcleanupworker stdout | 2020-07-23 07:06:11,232 [119] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'blobuploadcleanupworker.py', 'pid': '119'} notificationworker stdout | 2020-07-23 07:06:11,999 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:06:12,000 [113] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:07:11 UTC)" (scheduled at 2020-07-23 07:06:11.998621+00:00) 2020-07-23 07:06:12,000 [113] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:06:12,000 [113] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:07:11 UTC)" executed successfully notificationworker stdout | 2020-07-23 07:06:12,001 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:19.911177+00:00 (in 7.911054 seconds) security_notification_worker stdout | 2020-07-23 07:06:12,699 [101] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'security_notification_worker.py', 'pid': '101'} logrotateworker stdout | 2020-07-23 07:06:12,778 [118] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'logrotateworker.py', 'pid': '118'} storagereplication stdout | 2020-07-23 07:06:12,819 [133] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'storagereplication.py', 'pid': '133'} repositoryactioncounter stdout | 2020-07-23 07:06:14,118 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositoryactioncounter.py', 'pid': '114'} servicekey stdout | 2020-07-23 07:06:14,754 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'servicekeyworker.py', 'pid': '98'} gunicorn-web stdout | 2020-07-23 07:06:15,647 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '104'} gunicorn-web stdout | 2020-07-23 07:06:15,650 [435] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '435'} gunicorn-web stdout | 2020-07-23 07:06:15,652 [419] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '419'} gunicorn-web stdout | 2020-07-23 07:06:15,655 [438] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '438'} gunicorn-web stdout | 2020-07-23 07:06:15,659 [433] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '433'} gunicorn-web stdout | 2020-07-23 07:06:15,662 [431] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '431'} gunicorn-web stdout | 2020-07-23 07:06:15,664 [436] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '436'} gunicorn-web stdout | 2020-07-23 07:06:15,667 [423] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '423'} gunicorn-web stdout | 2020-07-23 07:06:15,669 [420] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '420'} repositoryactioncounter stdout | 2020-07-23 07:06:18,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:06:18,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:28.291018+00:00 (in 9.998917 seconds) 2020-07-23 07:06:18,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:06:28 UTC)" (scheduled at 2020-07-23 07:06:18.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:06:18,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:06:18,304 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:06:18,304 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:06:18,305 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:06:28 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:06:18,382 [438] [DEBUG] [app] Starting request: urn:request:293fb9e6-c9f1-42c4-a90d-26d6571c7851 (/health/instance) gunicorn-web stdout | 2020-07-23 07:06:18,384 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:06:18,389 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:06:18,391 [463] [DEBUG] [app] Starting request: urn:request:c7c44826-a424-42bd-8362-cdebb4ff94de (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:06:18,393 [463] [DEBUG] [app] Ending request: urn:request:c7c44826-a424-42bd-8362-cdebb4ff94de (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:06:18,393 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:06:18 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:18 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:06:18,394 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:06:18,395 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:06:18,400 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:06:18,408 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:06:18,412 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:06:18,414 [438] [DEBUG] [app] Starting request: urn:request:d260c6c2-0237-4e1b-8f25-769fb3c1f800 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:06:18,415 [438] [DEBUG] [app] Ending request: urn:request:d260c6c2-0237-4e1b-8f25-769fb3c1f800 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:06:18,415 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:06:18 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:18 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 159 0.002) gunicorn-web stdout | 2020-07-23 07:06:18,416 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:06:18,419 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:18 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:06:18,420 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:06:18,423 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:18 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:06:18,424 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:06:18,427 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:06:18,429 [466] [DEBUG] [app] Starting request: urn:request:2aa10c84-e0bf-488b-8cb7-8f7322f8ed6d (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:06:18,430 [466] [DEBUG] [app] Ending request: urn:request:2aa10c84-e0bf-488b-8cb7-8f7322f8ed6d (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:06:18,431 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:18 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:06:18,431 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:06:18 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:06:18,433 [438] [DEBUG] [app] Ending request: urn:request:293fb9e6-c9f1-42c4-a90d-26d6571c7851 (/health/instance) 2020-07-23 07:06:18,433 [438] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:06:18 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.053 49 0.053) gunicorn-web stdout | 2020-07-23 07:06:18,434 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:06:18 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" notificationworker stdout | 2020-07-23 07:06:19,912 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:06:19,913 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:29.911177+00:00 (in 9.998277 seconds) 2020-07-23 07:06:19,913 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:06:29 UTC)" (scheduled at 2020-07-23 07:06:19.911177+00:00) 2020-07-23 07:06:19,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:06:19,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 6, 19, 913884), True, datetime.datetime(2020, 7, 23, 7, 6, 19, 913884), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:06:19,925 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:06:19,926 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:06:19,926 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:06:29 UTC)" executed successfully builder stdout | 2020-07-23 07:06:20,460 [130] [DEBUG] [buildman.server] Writing metrics builder stdout | 2020-07-23 07:06:20,475 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds builder stdout | 2020-07-23 07:06:20,496 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:06:20,502 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:06:20,502 [130] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:06:21,739 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:06:21,740 [102] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:06:21 UTC)" (scheduled at 2020-07-23 07:06:21.739118+00:00) 2020-07-23 07:06:21,740 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:28.907644+00:00 (in 7.167855 seconds) repositorygcworker stdout | 2020-07-23 07:06:21,740 [102] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2020-07-23 07:06:21,742 [102] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 6, 21, 741060), True, datetime.datetime(2020, 7, 23, 7, 6, 21, 741060), 0, u'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2020-07-23 07:06:21,751 [102] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:06:21,751 [102] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:06:21,752 [102] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:07:21 UTC)" executed successfully gunicorn-registry stdout | 2020-07-23 07:06:22,360 [469] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '469'} gunicorn-registry stdout | 2020-07-23 07:06:22,365 [100] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '100'} gunicorn-registry stdout | 2020-07-23 07:06:22,372 [463] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '463'} gunicorn-registry stdout | 2020-07-23 07:06:22,392 [477] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '477'} gunicorn-registry stdout | 2020-07-23 07:06:22,397 [478] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '478'} gunicorn-registry stdout | 2020-07-23 07:06:22,400 [480] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '480'} gunicorn-registry stdout | 2020-07-23 07:06:22,403 [470] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '470'} gunicorn-registry stdout | 2020-07-23 07:06:22,407 [475] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '475'} gunicorn-registry stdout | 2020-07-23 07:06:22,409 [476] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '476'} gunicorn-registry stdout | 2020-07-23 07:06:22,413 [479] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '479'} gunicorn-verbs stdout | 2020-07-23 07:06:22,417 [127] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'verbs:application', 'pid': '127'} gunicorn-registry stdout | 2020-07-23 07:06:22,419 [474] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '474'} gunicorn-registry stdout | 2020-07-23 07:06:22,424 [467] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '467'} gunicorn-registry stdout | 2020-07-23 07:06:22,427 [465] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '465'} gunicorn-registry stdout | 2020-07-23 07:06:22,430 [472] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '472'} gunicorn-registry stdout | 2020-07-23 07:06:22,433 [471] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '471'} gunicorn-registry stdout | 2020-07-23 07:06:22,436 [473] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '473'} gunicorn-registry stdout | 2020-07-23 07:06:22,439 [481] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '481'} buildlogsarchiver stdout | 2020-07-23 07:06:26,399 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:06:26,399 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:56.395393+00:00 (in 29.995766 seconds) 2020-07-23 07:06:26,400 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:06:56 UTC)" (scheduled at 2020-07-23 07:06:26.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:06:26,401 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 6, 26, 400527), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:06:26,412 [109] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2020-07-23 07:06:26,412 [109] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:06:26,413 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:06:56 UTC)" executed successfully repositoryactioncounter stdout | 2020-07-23 07:06:28,292 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:06:28,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:38.291018+00:00 (in 9.998556 seconds) 2020-07-23 07:06:28,293 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:06:38 UTC)" (scheduled at 2020-07-23 07:06:28.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:06:28,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:06:28,304 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:06:28,305 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:06:28,305 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:06:38 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:06:28,387 [436] [DEBUG] [app] Starting request: urn:request:0229ae12-23b6-428e-bdc5-d8a0306cbf1a (/health/instance) gunicorn-web stdout | 2020-07-23 07:06:28,393 [436] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): localhost:8443 gunicorn-web stdout | 2020-07-23 07:06:28,400 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:06:28,402 [463] [DEBUG] [app] Starting request: urn:request:b8a7614c-6735-4dc0-8525-facee082cf3c (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:06:28,403 [463] [DEBUG] [app] Ending request: urn:request:b8a7614c-6735-4dc0-8525-facee082cf3c (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:06:28,404 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:06:28 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:28 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:06:28,404 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:06:28,408 [436] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:06:28,415 [436] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:06:28,425 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:06:28,430 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:06:28,432 [436] [DEBUG] [app] Starting request: urn:request:b897887c-a6fc-4902-b6ab-8bc9f7362afb (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:06:28,434 [436] [DEBUG] [app] Ending request: urn:request:b897887c-a6fc-4902-b6ab-8bc9f7362afb (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:28 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:06:28,435 [436] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:06:28 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:06:28,435 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:06:28,439 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:28 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:06:28,439 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:06:28,443 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:06:28,444 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:28 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:06:28,447 [436] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2020, 7, 23, 7, 6, 28, 446106), None, u'quay', u'quay', datetime.datetime(2020, 7, 23, 7, 6, 28, 446177), u'quay', None, datetime.datetime(2020, 7, 22, 7, 6, 28, 446211), datetime.datetime(2020, 7, 16, 7, 6, 28, 446251), None]) gunicorn-web stdout | 2020-07-23 07:06:28,460 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:06:28,462 [466] [DEBUG] [app] Starting request: urn:request:7aca42ad-093b-49a4-9d67-c2f97ba56447 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:06:28,463 [466] [DEBUG] [app] Ending request: urn:request:7aca42ad-093b-49a4-9d67-c2f97ba56447 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:28 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:06:28,464 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:06:28,463 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:06:28 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:06:28,466 [436] [DEBUG] [app] Ending request: urn:request:0229ae12-23b6-428e-bdc5-d8a0306cbf1a (/health/instance) gunicorn-web stdout | 2020-07-23 07:06:28,466 [436] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:06:28,467 [436] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:06:28 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:06:28 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.086 49 0.086) repositorygcworker stdout | 2020-07-23 07:06:28,909 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:06:28,909 [102] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:06:28 UTC)" (scheduled at 2020-07-23 07:06:28.907644+00:00) 2020-07-23 07:06:28,910 [102] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2020-07-23 07:06:28,910 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:06.904189+00:00 (in 37.994908 seconds) 2020-07-23 07:06:28,910 [102] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:07:28 UTC)" executed successfully notificationworker stdout | 2020-07-23 07:06:29,912 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:06:29,913 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:39.911177+00:00 (in 9.998507 seconds) 2020-07-23 07:06:29,913 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:06:39 UTC)" (scheduled at 2020-07-23 07:06:29.911177+00:00) 2020-07-23 07:06:29,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:06:29,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 6, 29, 913698), True, datetime.datetime(2020, 7, 23, 7, 6, 29, 913698), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:06:29,924 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:06:29,925 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:06:29,925 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:06:39 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:06:30,353 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:06:30,353 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:52.446816+00:00 (in 22.093546 seconds) 2020-07-23 07:06:30,353 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:07:00 UTC)" (scheduled at 2020-07-23 07:06:30.351857+00:00) 2020-07-23 07:06:30,354 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:06:30,356 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 6, 30, 354314), True, datetime.datetime(2020, 7, 23, 7, 6, 30, 354314), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:06:30,366 [101] [DEBUG] [workers.queueworker] No more work. security_notification_worker stdout | 2020-07-23 07:06:30,366 [101] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:06:30,366 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:07:00 UTC)" executed successfully builder stdout | 2020-07-23 07:06:30,513 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:06:30,523 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:06:30,523 [130] [DEBUG] [data.database] Disconnecting from database. securityworker stdout | 2020-07-23 07:06:33,479 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run securityworker stdout | 2020-07-23 07:06:33,479 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:03.476607+00:00 (in 29.997006 seconds) 2020-07-23 07:06:33,480 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:07:03 UTC)" (scheduled at 2020-07-23 07:06:33.476607+00:00) securityworker stdout | 2020-07-23 07:06:33,481 [128] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "image" AS "t1" WHERE ("t1"."security_indexed_engine" < %s)', [3]) securityworker stdout | 2020-07-23 07:06:33,489 [128] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "image" AS "t1"', []) securityworker stdout | 2020-07-23 07:06:33,490 [128] [DEBUG] [data.secscan_model.secscan_v2_model] Found no additional images to scan 2020-07-23 07:06:33,490 [128] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:06:33,491 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:07:03 UTC)" executed successfully gcworker stdout | 2020-07-23 07:06:34,456 [110] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'gcworker.py', 'pid': '110'} expiredappspecifictokenworker stdout | 2020-07-23 07:06:34,820 [126] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '126'} securityworker stdout | 2020-07-23 07:06:35,463 [128] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'securityworker.py', 'pid': '128'} teamsyncworker stdout | 2020-07-23 07:06:35,810 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'teamsyncworker.py', 'pid': '115'} exportactionlogsworker stdout | 2020-07-23 07:06:37,214 [99] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'exportactionlogsworker.py', 'pid': '99'} queuecleanupworker stdout | 2020-07-23 07:06:37,626 [103] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'queuecleanupworker.py', 'pid': '103'} gunicorn-secscan stdout | 2020-07-23 07:06:37,802 [413] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '413'} gunicorn-secscan stdout | 2020-07-23 07:06:37,805 [412] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '412'} gunicorn-secscan stdout | 2020-07-23 07:06:37,809 [122] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '122'} gunicorn-secscan stdout | 2020-07-23 07:06:37,813 [414] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '414'} gunicorn-secscan stdout | 2020-07-23 07:06:37,817 [411] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '411'} repositoryactioncounter stdout | 2020-07-23 07:06:38,294 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:06:38,295 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:48.291018+00:00 (in 9.995934 seconds) 2020-07-23 07:06:38,295 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:06:48 UTC)" (scheduled at 2020-07-23 07:06:38.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:06:38,297 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:06:38,305 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:06:38,306 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:06:38,306 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:06:48 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:06:38,385 [438] [DEBUG] [app] Starting request: urn:request:2563d75b-9f34-4156-af7b-38f495598069 (/health/instance) gunicorn-web stdout | 2020-07-23 07:06:38,387 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:06:38,393 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:06:38,395 [463] [DEBUG] [app] Starting request: urn:request:09592272-85da-43a4-857d-7e0d166014d4 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:06:38,397 [463] [DEBUG] [app] Ending request: urn:request:09592272-85da-43a4-857d-7e0d166014d4 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:38 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-registry stdout | 2020-07-23 07:06:38,397 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:06:38 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:06:38,398 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:06:38,399 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:06:38,406 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:06:38,414 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:06:38,419 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:06:38,421 [438] [DEBUG] [app] Starting request: urn:request:fbb4a65e-4ba0-43bc-9ee1-8190a179ca96 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:06:38,422 [438] [DEBUG] [app] Ending request: urn:request:fbb4a65e-4ba0-43bc-9ee1-8190a179ca96 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:38 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:06:38,423 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:06:38 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:06:38,423 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:06:38,427 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:38 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:06:38,428 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:06:38,431 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:38 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:06:38,433 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:06:38,437 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:06:38,439 [466] [DEBUG] [app] Starting request: urn:request:63c23be9-e70a-443c-9210-0e9e4ed89fdb (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:06:38,440 [466] [DEBUG] [app] Ending request: urn:request:63c23be9-e70a-443c-9210-0e9e4ed89fdb (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:38 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:06:38,440 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:06:38 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:06:38,441 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:06:38,444 [438] [DEBUG] [app] Ending request: urn:request:2563d75b-9f34-4156-af7b-38f495598069 (/health/instance) gunicorn-web stdout | 2020-07-23 07:06:38,444 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:06:38,445 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:06:38 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:06:38 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.062 49 0.062) globalpromstats stdout | 2020-07-23 07:06:38,478 [129] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'globalpromstats.py', 'pid': '129'} buildlogsarchiver stdout | 2020-07-23 07:06:38,828 [109] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'buildlogsarchiver.py', 'pid': '109'} namespacegcworker stdout | 2020-07-23 07:06:39,030 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:06:39,030 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:06.910005+00:00 (in 27.879653 seconds) 2020-07-23 07:06:39,030 [134] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:07:39 UTC)" (scheduled at 2020-07-23 07:06:39.024941+00:00) 2020-07-23 07:06:39,031 [134] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:06:39,031 [134] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:07:39 UTC)" executed successfully notificationworker stdout | 2020-07-23 07:06:39,110 [113] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'notificationworker.py', 'pid': '113'} chunkcleanupworker stdout | 2020-07-23 07:06:39,274 [124] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'chunkcleanupworker.py', 'pid': '124'} notificationworker stdout | 2020-07-23 07:06:39,912 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:06:39,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:49.911177+00:00 (in 9.998954 seconds) 2020-07-23 07:06:39,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:06:49 UTC)" (scheduled at 2020-07-23 07:06:39.911177+00:00) 2020-07-23 07:06:39,912 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:06:39,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 6, 39, 913016), True, datetime.datetime(2020, 7, 23, 7, 6, 39, 913016), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:06:39,924 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:06:39,925 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:06:39,925 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:06:49 UTC)" executed successfully gcworker stdout | 2020-07-23 07:06:40,007 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2020-07-23 07:06:40,007 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:10.004697+00:00 (in 29.996999 seconds) 2020-07-23 07:06:40,008 [110] [INFO] [apscheduler.executors.default] Running job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:07:10 UTC)" (scheduled at 2020-07-23 07:06:40.004697+00:00) gcworker stdout | 2020-07-23 07:06:40,010 [110] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1594278400008, 1209600, 500, 1, 0]) gcworker stdout | 2020-07-23 07:06:40,020 [110] [DEBUG] [__main__] No repository with garbage found 2020-07-23 07:06:40,020 [110] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2020-07-23 07:06:40,020 [110] [INFO] [apscheduler.executors.default] Job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:07:10 UTC)" executed successfully builder stdout | 2020-07-23 07:06:40,474 [130] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'builder.py', 'pid': '130'} builder stdout | 2020-07-23 07:06:40,533 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:06:40,545 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:06:40,545 [130] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2020-07-23 07:06:40,774 [134] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'namespacegcworker.py', 'pid': '134'} repositorygcworker stdout | 2020-07-23 07:06:40,780 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositorygcworker.py', 'pid': '102'} blobuploadcleanupworker stdout | 2020-07-23 07:06:41,274 [119] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'blobuploadcleanupworker.py', 'pid': '119'} security_notification_worker stdout | 2020-07-23 07:06:42,739 [101] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'security_notification_worker.py', 'pid': '101'} logrotateworker stdout | 2020-07-23 07:06:42,817 [118] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'logrotateworker.py', 'pid': '118'} storagereplication stdout | 2020-07-23 07:06:42,845 [133] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'storagereplication.py', 'pid': '133'} repositoryactioncounter stdout | 2020-07-23 07:06:44,143 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositoryactioncounter.py', 'pid': '114'} servicekey stdout | 2020-07-23 07:06:44,792 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'servicekeyworker.py', 'pid': '98'} gunicorn-web stdout | 2020-07-23 07:06:45,660 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '104'} gunicorn-web stdout | 2020-07-23 07:06:45,674 [435] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '435'} gunicorn-web stdout | 2020-07-23 07:06:45,678 [419] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '419'} gunicorn-web stdout | 2020-07-23 07:06:45,684 [438] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '438'} gunicorn-web stdout | 2020-07-23 07:06:45,687 [431] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '431'} gunicorn-web stdout | 2020-07-23 07:06:45,692 [433] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '433'} gunicorn-web stdout | 2020-07-23 07:06:45,694 [436] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '436'} gunicorn-web stdout | 2020-07-23 07:06:45,698 [420] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '420'} gunicorn-web stdout | 2020-07-23 07:06:45,702 [423] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '423'} repositoryactioncounter stdout | 2020-07-23 07:06:48,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:06:48,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:58.291018+00:00 (in 9.998974 seconds) 2020-07-23 07:06:48,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:06:58 UTC)" (scheduled at 2020-07-23 07:06:48.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:06:48,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:06:48,304 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:06:48,304 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:06:48,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:06:58 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:06:48,386 [419] [DEBUG] [app] Starting request: urn:request:0f0f6b16-bc1e-4d36-9690-3dd41a6015e1 (/health/instance) gunicorn-web stdout | 2020-07-23 07:06:48,393 [419] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): localhost:8443 gunicorn-web stdout | 2020-07-23 07:06:48,401 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:06:48,405 [467] [DEBUG] [app] Starting request: urn:request:f6abd5d8-6b93-4dd6-bc6d-28ac8602eadd (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:06:48,408 [467] [DEBUG] [app] Ending request: urn:request:f6abd5d8-6b93-4dd6-bc6d-28ac8602eadd (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.008 162 0.008) gunicorn-registry stdout | 2020-07-23 07:06:48,409 [467] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:06:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:06:48,409 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:06:48,413 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:06:48,414 [438] [DEBUG] [app] Starting request: urn:request:b70d70ad-1abf-41fb-a291-fc1f7a319275 (/health/instance) gunicorn-web stdout | 2020-07-23 07:06:48,417 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:06:48,421 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:06:48,422 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:06:48,424 [463] [DEBUG] [app] Starting request: urn:request:fe6a0b49-f4a2-4898-b1f0-7cf9f8ec0d81 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:06:48,425 [463] [DEBUG] [app] Ending request: urn:request:fe6a0b49-f4a2-4898-b1f0-7cf9f8ec0d81 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:06:48,426 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:06:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:06:48,427 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:06:48,428 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:06:48,430 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:06:48,433 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:06:48,436 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:06:48,438 [419] [DEBUG] [app] Starting request: urn:request:345b99e7-3a76-4f36-aa4f-8fab1b3ab4d6 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:06:48,441 [419] [DEBUG] [app] Ending request: urn:request:345b99e7-3a76-4f36-aa4f-8fab1b3ab4d6 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:06:48,441 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:06:48,442 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:06:48 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:48 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.005 159 0.005) gunicorn-web stdout | 2020-07-23 07:06:48,443 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:06:48,447 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) 2020-07-23 07:06:48,447 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:48 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:06:48,448 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:06:48,451 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:06:48,454 [433] [DEBUG] [app] Starting request: urn:request:6ac6e928-2930-4525-a372-431fadd9f27d (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:06:48,456 [433] [DEBUG] [app] Ending request: urn:request:6ac6e928-2930-4525-a372-431fadd9f27d (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:06:48,457 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:48 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:06:48,458 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:48 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.010 159 0.010) gunicorn-web stdout | 2020-07-23 07:06:48,457 [433] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:06:48 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:06:48,460 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2020, 7, 23, 7, 6, 48, 458906), None, u'quay', u'quay', datetime.datetime(2020, 7, 23, 7, 6, 48, 458967), u'quay', None, datetime.datetime(2020, 7, 22, 7, 6, 48, 458999), datetime.datetime(2020, 7, 16, 7, 6, 48, 459034), None]) gunicorn-web stdout | 2020-07-23 07:06:48,462 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:06:48,463 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:48 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:06:48,466 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:48 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:06:48,468 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:06:48,473 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:06:48,475 [466] [DEBUG] [app] Starting request: urn:request:713943d9-25e0-4459-a801-da18a322127d (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:06:48,476 [466] [DEBUG] [app] Ending request: urn:request:713943d9-25e0-4459-a801-da18a322127d (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:06:48,477 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:06:48,477 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:06:48 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:48 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:06:48,481 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:06:48,483 [438] [DEBUG] [app] Ending request: urn:request:b70d70ad-1abf-41fb-a291-fc1f7a319275 (/health/instance) gunicorn-web stdout | 2020-07-23 07:06:48,484 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:06:48,485 [438] [INFO] [gunicorn.access] 10.131.0.4 - - [23/Jul/2020:07:06:48 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "ansible-httpget" nginx stdout | 10.131.0.4 () - - [23/Jul/2020:07:06:48 +0000] "GET /health/instance HTTP/1.1" 200 190 "-" "ansible-httpget" (0.072 201 0.072) gunicorn-verbs stdout | 2020-07-23 07:06:48,486 [458] [DEBUG] [app] Starting request: urn:request:68454e3d-6047-4d61-8643-b59b22e39765 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:06:48,491 [458] [DEBUG] [app] Ending request: urn:request:68454e3d-6047-4d61-8643-b59b22e39765 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:48 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.015 162 0.015) gunicorn-web stdout | 2020-07-23 07:06:48,493 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:06:48,492 [458] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:06:48 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:06:48,495 [419] [DEBUG] [app] Ending request: urn:request:0f0f6b16-bc1e-4d36-9690-3dd41a6015e1 (/health/instance) 2020-07-23 07:06:48,496 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:06:48,497 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:06:48 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:06:48 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.117 49 0.117) notificationworker stdout | 2020-07-23 07:06:49,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:06:49,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:06:59.911177+00:00 (in 9.999029 seconds) notificationworker stdout | 2020-07-23 07:06:49,913 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:06:59 UTC)" (scheduled at 2020-07-23 07:06:49.911177+00:00) 2020-07-23 07:06:49,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:06:49,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 6, 49, 913269), True, datetime.datetime(2020, 7, 23, 7, 6, 49, 913269), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:06:49,926 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:06:49,926 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:06:49,926 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:06:59 UTC)" executed successfully builder stdout | 2020-07-23 07:06:50,487 [130] [DEBUG] [buildman.server] Writing metrics builder stdout | 2020-07-23 07:06:50,500 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds builder stdout | 2020-07-23 07:06:50,547 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:06:50,552 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:06:50,553 [130] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2020-07-23 07:06:52,376 [469] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '469'} gunicorn-registry stdout | 2020-07-23 07:06:52,381 [100] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '100'} gunicorn-registry stdout | 2020-07-23 07:06:52,385 [463] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '463'} gunicorn-registry stdout | 2020-07-23 07:06:52,403 [477] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '477'} gunicorn-registry stdout | 2020-07-23 07:06:52,407 [478] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '478'} gunicorn-registry stdout | 2020-07-23 07:06:52,411 [480] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '480'} gunicorn-registry stdout | 2020-07-23 07:06:52,416 [470] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '470'} gunicorn-registry stdout | 2020-07-23 07:06:52,421 [475] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '475'} gunicorn-registry stdout | 2020-07-23 07:06:52,426 [476] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '476'} gunicorn-registry stdout | 2020-07-23 07:06:52,430 [479] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '479'} gunicorn-registry stdout | 2020-07-23 07:06:52,438 [474] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '474'} gunicorn-registry stdout | 2020-07-23 07:06:52,443 [467] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '467'} gunicorn-registry stdout | 2020-07-23 07:06:52,447 [465] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '465'} security_notification_worker stdout | 2020-07-23 07:06:52,447 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:06:52,448 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:00.351857+00:00 (in 7.903818 seconds) security_notification_worker stdout | 2020-07-23 07:06:52,448 [101] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:07:52 UTC)" (scheduled at 2020-07-23 07:06:52.446816+00:00) 2020-07-23 07:06:52,448 [101] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:06:52,448 [101] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:07:52 UTC)" executed successfully gunicorn-registry stdout | 2020-07-23 07:06:52,450 [472] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '472'} gunicorn-registry stdout | 2020-07-23 07:06:52,454 [471] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '471'} gunicorn-registry stdout | 2020-07-23 07:06:52,458 [473] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '473'} gunicorn-registry stdout | 2020-07-23 07:06:52,462 [481] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '481'} gunicorn-verbs stdout | 2020-07-23 07:06:52,527 [127] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'verbs:application', 'pid': '127'} buildlogsarchiver stdout | 2020-07-23 07:06:56,396 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:06:56,396 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:26.395393+00:00 (in 29.999012 seconds) 2020-07-23 07:06:56,397 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:07:26 UTC)" (scheduled at 2020-07-23 07:06:56.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:06:56,398 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 6, 56, 397459), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:06:56,406 [109] [DEBUG] [__main__] No more builds to archive 2020-07-23 07:06:56,406 [109] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2020-07-23 07:06:56,407 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:07:26 UTC)" executed successfully repositoryactioncounter stdout | 2020-07-23 07:06:58,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:06:58,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:08.291018+00:00 (in 9.999086 seconds) 2020-07-23 07:06:58,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:07:08 UTC)" (scheduled at 2020-07-23 07:06:58.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:06:58,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:06:58,302 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:06:58,303 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:06:58,303 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:07:08 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:06:58,383 [419] [DEBUG] [app] Starting request: urn:request:e7e5ceba-7ae3-451c-88ca-f2c5bbf7befc (/health/instance) gunicorn-web stdout | 2020-07-23 07:06:58,385 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:06:58,390 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:06:58,394 [471] [DEBUG] [app] Starting request: urn:request:f22c7ea6-d7c8-43a6-9fd5-9db3d63ff96d (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:06:58,396 [471] [DEBUG] [app] Ending request: urn:request:f22c7ea6-d7c8-43a6-9fd5-9db3d63ff96d (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.007 162 0.007) gunicorn-registry stdout | 2020-07-23 07:06:58,397 [471] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:06:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:06:58,398 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:06:58,399 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:06:58,405 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:06:58,412 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:06:58,416 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:06:58,418 [419] [DEBUG] [app] Starting request: urn:request:0174f56d-71e3-47ec-9d82-4673f633f6ae (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:06:58,419 [419] [DEBUG] [app] Ending request: urn:request:0174f56d-71e3-47ec-9d82-4673f633f6ae (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:58 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:06:58,419 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:06:58 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:06:58,420 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:06:58,423 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:58 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:06:58,424 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:06:58,427 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:06:58,428 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:58 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:06:58,432 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:06:58,434 [458] [DEBUG] [app] Starting request: urn:request:423afdc5-b363-40d9-894d-773b20bf58b4 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:06:58,435 [458] [DEBUG] [app] Ending request: urn:request:423afdc5-b363-40d9-894d-773b20bf58b4 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:06:58 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:06:58,436 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:06:58,435 [458] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:06:58 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:06:58,437 [419] [DEBUG] [app] Ending request: urn:request:e7e5ceba-7ae3-451c-88ca-f2c5bbf7befc (/health/instance) 2020-07-23 07:06:58,437 [419] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:06:58 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.057 49 0.057) gunicorn-web stdout | 2020-07-23 07:06:58,438 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:06:58 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" notificationworker stdout | 2020-07-23 07:06:59,912 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:06:59,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:09.911177+00:00 (in 9.998864 seconds) 2020-07-23 07:06:59,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:07:09 UTC)" (scheduled at 2020-07-23 07:06:59.911177+00:00) 2020-07-23 07:06:59,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:06:59,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 6, 59, 913225), True, datetime.datetime(2020, 7, 23, 7, 6, 59, 913225), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:06:59,924 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:06:59,925 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:06:59,925 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:07:09 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:07:00,352 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:07:00,352 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:30.351857+00:00 (in 29.999188 seconds) 2020-07-23 07:07:00,353 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:07:30 UTC)" (scheduled at 2020-07-23 07:07:00.351857+00:00) 2020-07-23 07:07:00,353 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:07:00,355 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 7, 0, 353543), True, datetime.datetime(2020, 7, 23, 7, 7, 0, 353543), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:07:00,364 [101] [DEBUG] [workers.queueworker] No more work. security_notification_worker stdout | 2020-07-23 07:07:00,364 [101] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:07:00,364 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:07:30 UTC)" executed successfully builder stdout | 2020-07-23 07:07:00,563 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:07:00,574 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:07:00,574 [130] [DEBUG] [data.database] Disconnecting from database. securityworker stdout | 2020-07-23 07:07:03,477 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run securityworker stdout | 2020-07-23 07:07:03,477 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:33.476607+00:00 (in 29.998918 seconds) 2020-07-23 07:07:03,478 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:07:33 UTC)" (scheduled at 2020-07-23 07:07:03.476607+00:00) 2020-07-23 07:07:03,478 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:07:33 UTC)" executed successfully exportactionlogsworker stdout | 2020-07-23 07:07:03,972 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:07:03,972 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:08.212267+00:00 (in 4.239587 seconds) 2020-07-23 07:07:03,973 [99] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:08:03 UTC)" (scheduled at 2020-07-23 07:07:03.971686+00:00) 2020-07-23 07:07:03,973 [99] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2020-07-23 07:07:03,975 [99] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 7, 3, 973553), True, datetime.datetime(2020, 7, 23, 7, 7, 3, 973553), 0, u'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2020-07-23 07:07:03,983 [99] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2020-07-23 07:07:03,983 [99] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:07:03,983 [99] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:08:03 UTC)" executed successfully gcworker stdout | 2020-07-23 07:07:04,494 [110] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'gcworker.py', 'pid': '110'} expiredappspecifictokenworker stdout | 2020-07-23 07:07:04,857 [126] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '126'} securityworker stdout | 2020-07-23 07:07:05,502 [128] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'securityworker.py', 'pid': '128'} teamsyncworker stdout | 2020-07-23 07:07:05,844 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'teamsyncworker.py', 'pid': '115'} repositorygcworker stdout | 2020-07-23 07:07:06,905 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:07:06,906 [102] [INFO] [apscheduler.executors.default] Running job "update_queue_metrics (trigger: interval[0:05:00], next run at: 2020-07-23 07:12:06 UTC)" (scheduled at 2020-07-23 07:07:06.904189+00:00) repositorygcworker stdout | 2020-07-23 07:07:06,908 [102] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2020, 7, 23, 7, 7, 6, 906852), u'repositorygc/%']) repositorygcworker stdout | 2020-07-23 07:07:06,908 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:21.739118+00:00 (in 14.833043 seconds) namespacegcworker stdout | 2020-07-23 07:07:06,911 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:07:06,911 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:23.024302+00:00 (in 16.113018 seconds) 2020-07-23 07:07:06,912 [134] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:08:06 UTC)" (scheduled at 2020-07-23 07:07:06.910005+00:00) namespacegcworker stdout | 2020-07-23 07:07:06,912 [134] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2020-07-23 07:07:06,914 [134] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 7, 6, 912313), True, datetime.datetime(2020, 7, 23, 7, 7, 6, 912313), 0, u'namespacegc/%', 50, 1, 0]) repositorygcworker stdout | 2020-07-23 07:07:06,917 [102] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2020, 7, 23, 7, 7, 6, 906852), True, datetime.datetime(2020, 7, 23, 7, 7, 6, 906852), 0, u'repositorygc/%']) repositorygcworker stdout | 2020-07-23 07:07:06,922 [102] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2020, 7, 23, 7, 7, 6, 906852), True, datetime.datetime(2020, 7, 23, 7, 7, 6, 906852), 0, u'repositorygc/%', False, datetime.datetime(2020, 7, 23, 7, 7, 6, 906852), u'repositorygc/%']) repositorygcworker stdout | 2020-07-23 07:07:06,924 [102] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2020-07-23 07:07:06,924 [134] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:07:06,924 [134] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:07:06,924 [134] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:08:06 UTC)" executed successfully repositorygcworker stdout | 2020-07-23 07:07:06,924 [102] [INFO] [apscheduler.executors.default] Job "update_queue_metrics (trigger: interval[0:05:00], next run at: 2020-07-23 07:12:06 UTC)" executed successfully exportactionlogsworker stdout | 2020-07-23 07:07:07,251 [99] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'exportactionlogsworker.py', 'pid': '99'} queuecleanupworker stdout | 2020-07-23 07:07:07,663 [103] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'queuecleanupworker.py', 'pid': '103'} gunicorn-secscan stdout | 2020-07-23 07:07:07,817 [413] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '413'} gunicorn-secscan stdout | 2020-07-23 07:07:07,822 [412] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '412'} gunicorn-secscan stdout | 2020-07-23 07:07:07,826 [122] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '122'} gunicorn-secscan stdout | 2020-07-23 07:07:07,829 [414] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '414'} gunicorn-secscan stdout | 2020-07-23 07:07:07,832 [411] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '411'} exportactionlogsworker stdout | 2020-07-23 07:07:08,212 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:07:08,213 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:08:03.971686+00:00 (in 55.758550 seconds) 2020-07-23 07:07:08,213 [99] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:08:08 UTC)" (scheduled at 2020-07-23 07:07:08.212267+00:00) 2020-07-23 07:07:08,214 [99] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:07:08,214 [99] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:08:08 UTC)" executed successfully repositoryactioncounter stdout | 2020-07-23 07:07:08,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:07:08,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:18.291018+00:00 (in 9.999143 seconds) 2020-07-23 07:07:08,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:07:18 UTC)" (scheduled at 2020-07-23 07:07:08.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:07:08,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:07:08,301 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:07:08,302 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:07:08,302 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:07:18 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:07:08,382 [438] [DEBUG] [app] Starting request: urn:request:fd394871-c0e8-4b1a-9012-9ace651764ce (/health/instance) gunicorn-web stdout | 2020-07-23 07:07:08,385 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:07:08,390 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:07:08,395 [475] [DEBUG] [app] Starting request: urn:request:57b98179-3c13-4a8c-b12e-0845c778eec4 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:07:08,398 [475] [DEBUG] [app] Ending request: urn:request:57b98179-3c13-4a8c-b12e-0845c778eec4 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:08 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.008 162 0.008) gunicorn-registry stdout | 2020-07-23 07:07:08,399 [475] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:08 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:07:08,399 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:07:08,401 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:07:08,406 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:07:08,414 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:07:08,420 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:07:08,422 [438] [DEBUG] [app] Starting request: urn:request:021eb9cf-7e6b-40a8-b7d8-03591cf83981 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:07:08,423 [438] [DEBUG] [app] Ending request: urn:request:021eb9cf-7e6b-40a8-b7d8-03591cf83981 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:08 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 159 0.002) gunicorn-web stdout | 2020-07-23 07:07:08,423 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:08 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:07:08,424 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:07:08,427 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:08 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:07:08,429 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:07:08,432 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:08 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:07:08,433 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:07:08,436 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:07:08,438 [458] [DEBUG] [app] Starting request: urn:request:fc5fa442-8977-4e5f-81f7-e163a227324f (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:07:08,439 [458] [DEBUG] [app] Ending request: urn:request:fc5fa442-8977-4e5f-81f7-e163a227324f (/c1/_internal_ping) 2020-07-23 07:07:08,440 [458] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:08 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:07:08,441 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:08 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:07:08,442 [438] [DEBUG] [app] Ending request: urn:request:fd394871-c0e8-4b1a-9012-9ace651764ce (/health/instance) 2020-07-23 07:07:08,443 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:07:08,443 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:07:08 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:07:08 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.062 49 0.062) globalpromstats stdout | 2020-07-23 07:07:08,514 [129] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'globalpromstats.py', 'pid': '129'} buildlogsarchiver stdout | 2020-07-23 07:07:08,866 [109] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'buildlogsarchiver.py', 'pid': '109'} notificationworker stdout | 2020-07-23 07:07:09,123 [113] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'notificationworker.py', 'pid': '113'} chunkcleanupworker stdout | 2020-07-23 07:07:09,309 [124] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'chunkcleanupworker.py', 'pid': '124'} gunicorn-web stdout | 2020-07-23 07:07:09,384 [436] [DEBUG] [app] Starting request: urn:request:e788e43c-eebc-4d85-9f81-726df61484f2 (/health/instance) gunicorn-web stdout | 2020-07-23 07:07:09,387 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:07:09,392 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:07:09,394 [463] [DEBUG] [app] Starting request: urn:request:1694a066-a5e3-4f62-aa39-42def4a1c667 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:07:09,395 [463] [DEBUG] [app] Ending request: urn:request:1694a066-a5e3-4f62-aa39-42def4a1c667 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:07:09,396 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:07:09,396 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:07:09,397 [436] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:07:09,403 [436] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:07:09,410 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:07:09,415 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:07:09,417 [436] [DEBUG] [app] Starting request: urn:request:e77cb61b-6b09-4483-9a96-5e7673ad97cf (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:07:09,418 [436] [DEBUG] [app] Ending request: urn:request:e77cb61b-6b09-4483-9a96-5e7673ad97cf (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:07:09,419 [436] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 159 0.002) gunicorn-web stdout | 2020-07-23 07:07:09,419 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:07:09,422 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:09 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:07:09,423 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:07:09,426 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:07:09,428 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:09 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:07:09,432 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:07:09,434 [458] [DEBUG] [app] Starting request: urn:request:35fdc4c0-08cd-46b4-a5c4-035549f53a51 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:07:09,435 [458] [DEBUG] [app] Ending request: urn:request:35fdc4c0-08cd-46b4-a5c4-035549f53a51 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:09 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:07:09,435 [458] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:09 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:07:09,436 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:07:09,437 [436] [DEBUG] [app] Ending request: urn:request:e788e43c-eebc-4d85-9f81-726df61484f2 (/health/instance) gunicorn-web stdout | 2020-07-23 07:07:09,438 [436] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:07:09,438 [436] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:07:09 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:07:09 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.056 49 0.056) notificationworker stdout | 2020-07-23 07:07:09,912 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:07:09,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:07:19 UTC)" (scheduled at 2020-07-23 07:07:09.911177+00:00) 2020-07-23 07:07:09,913 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:11.998621+00:00 (in 2.086224 seconds) 2020-07-23 07:07:09,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:07:09,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 7, 9, 913595), True, datetime.datetime(2020, 7, 23, 7, 7, 9, 913595), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:07:09,931 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:07:09,931 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:07:09,932 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:07:19 UTC)" executed successfully gcworker stdout | 2020-07-23 07:07:10,005 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2020-07-23 07:07:10,005 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:40.004697+00:00 (in 29.999234 seconds) 2020-07-23 07:07:10,006 [110] [INFO] [apscheduler.executors.default] Running job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:07:40 UTC)" (scheduled at 2020-07-23 07:07:10.004697+00:00) gcworker stdout | 2020-07-23 07:07:10,008 [110] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1594278430006, 1209600, 500, 1, 0]) gcworker stdout | 2020-07-23 07:07:10,018 [110] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2020-07-23 07:07:10,018 [110] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:07:10,019 [110] [INFO] [apscheduler.executors.default] Job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:07:40 UTC)" executed successfully builder stdout | 2020-07-23 07:07:10,512 [130] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'builder.py', 'pid': '130'} builder stdout | 2020-07-23 07:07:10,584 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:07:10,599 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:07:10,599 [130] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:07:10,806 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositorygcworker.py', 'pid': '102'} namespacegcworker stdout | 2020-07-23 07:07:10,810 [134] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'namespacegcworker.py', 'pid': '134'} blobuploadcleanupworker stdout | 2020-07-23 07:07:11,312 [119] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'blobuploadcleanupworker.py', 'pid': '119'} notificationworker stdout | 2020-07-23 07:07:11,999 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:07:12,000 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:19.911177+00:00 (in 7.910989 seconds) 2020-07-23 07:07:12,000 [113] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:08:11 UTC)" (scheduled at 2020-07-23 07:07:11.998621+00:00) 2020-07-23 07:07:12,001 [113] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:07:12,001 [113] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:08:11 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:07:12,778 [101] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'security_notification_worker.py', 'pid': '101'} logrotateworker stdout | 2020-07-23 07:07:12,850 [118] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'logrotateworker.py', 'pid': '118'} storagereplication stdout | 2020-07-23 07:07:12,874 [133] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'storagereplication.py', 'pid': '133'} repositoryactioncounter stdout | 2020-07-23 07:07:14,174 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositoryactioncounter.py', 'pid': '114'} servicekey stdout | 2020-07-23 07:07:14,828 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'servicekeyworker.py', 'pid': '98'} gunicorn-web stdout | 2020-07-23 07:07:15,678 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '104'} gunicorn-web stdout | 2020-07-23 07:07:15,690 [435] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '435'} gunicorn-web stdout | 2020-07-23 07:07:15,705 [419] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '419'} gunicorn-web stdout | 2020-07-23 07:07:15,711 [438] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '438'} gunicorn-web stdout | 2020-07-23 07:07:15,716 [433] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '433'} gunicorn-web stdout | 2020-07-23 07:07:15,721 [431] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '431'} gunicorn-web stdout | 2020-07-23 07:07:15,725 [436] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '436'} gunicorn-web stdout | 2020-07-23 07:07:15,730 [420] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '420'} gunicorn-web stdout | 2020-07-23 07:07:15,734 [423] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '423'} repositoryactioncounter stdout | 2020-07-23 07:07:18,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:07:18,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:07:28 UTC)" (scheduled at 2020-07-23 07:07:18.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:07:18,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) 2020-07-23 07:07:18,295 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:28.291018+00:00 (in 9.999115 seconds) repositoryactioncounter stdout | 2020-07-23 07:07:18,303 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:07:18,303 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:07:18,303 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:07:28 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:07:18,382 [438] [DEBUG] [app] Starting request: urn:request:26e3444c-42c0-46d3-b62c-791c7b82a510 (/health/instance) gunicorn-web stdout | 2020-07-23 07:07:18,385 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:07:18,390 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:07:18,392 [463] [DEBUG] [app] Starting request: urn:request:7d969d63-9a56-422d-a50e-60458c8adc41 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:07:18,393 [463] [DEBUG] [app] Ending request: urn:request:7d969d63-9a56-422d-a50e-60458c8adc41 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:07:18,393 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:18 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:18 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:07:18,394 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:07:18,395 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:07:18,401 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:07:18,409 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:07:18,414 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:07:18,415 [438] [DEBUG] [app] Starting request: urn:request:e918c26e-054a-4eb3-b08b-2e39e350edfc (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:07:18,416 [438] [DEBUG] [app] Ending request: urn:request:e918c26e-054a-4eb3-b08b-2e39e350edfc (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:07:18,417 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:18 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:18 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 159 0.002) gunicorn-web stdout | 2020-07-23 07:07:18,417 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:07:18,420 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:18 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:07:18,421 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:07:18,424 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:18 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:07:18,425 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:07:18,429 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:07:18,430 [466] [DEBUG] [app] Starting request: urn:request:d980788e-b569-4276-a324-46a401841fc0 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:07:18,431 [466] [DEBUG] [app] Ending request: urn:request:d980788e-b569-4276-a324-46a401841fc0 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:07:18,432 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:18 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 162 0.002) gunicorn-verbs stdout | 2020-07-23 07:07:18,431 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:18 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:07:18,433 [438] [DEBUG] [app] Ending request: urn:request:26e3444c-42c0-46d3-b62c-791c7b82a510 (/health/instance) 2020-07-23 07:07:18,433 [438] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:07:18 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.053 49 0.053) gunicorn-web stdout | 2020-07-23 07:07:18,434 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:07:18 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" gunicorn-web stdout | 2020-07-23 07:07:19,384 [436] [DEBUG] [app] Starting request: urn:request:569c6598-c109-47d0-9331-0bba008c5508 (/health/instance) gunicorn-web stdout | 2020-07-23 07:07:19,387 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:07:19,392 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:07:19,394 [463] [DEBUG] [app] Starting request: urn:request:a31210c0-f542-4667-866d-73608d02eb11 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:07:19,396 [463] [DEBUG] [app] Ending request: urn:request:a31210c0-f542-4667-866d-73608d02eb11 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:07:19,396 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:19 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:19 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:07:19,397 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:07:19,398 [436] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:07:19,403 [436] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:07:19,411 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:07:19,416 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:07:19,418 [436] [DEBUG] [app] Starting request: urn:request:340d63bd-67f8-471b-a3a8-d992b7697c82 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:07:19,419 [436] [DEBUG] [app] Ending request: urn:request:340d63bd-67f8-471b-a3a8-d992b7697c82 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:07:19,420 [436] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:19 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:19 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:07:19,420 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:07:19,424 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:19 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:07:19,425 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:07:19,428 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:07:19,429 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:19 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:07:19,433 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:07:19,438 [460] [DEBUG] [app] Starting request: urn:request:b5b5712e-d3a9-4a57-94d6-c07606449933 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:07:19,443 [460] [DEBUG] [app] Ending request: urn:request:b5b5712e-d3a9-4a57-94d6-c07606449933 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:07:19,444 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:19 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.011 162 0.011) gunicorn-verbs stdout | 2020-07-23 07:07:19,444 [460] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:19 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:07:19,446 [436] [DEBUG] [app] Ending request: urn:request:569c6598-c109-47d0-9331-0bba008c5508 (/health/instance) gunicorn-web stdout | 2020-07-23 07:07:19,447 [436] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:07:19,447 [436] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:07:19 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:07:19 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.064 49 0.064) notificationworker stdout | 2020-07-23 07:07:19,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:07:19,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:29.911177+00:00 (in 9.999050 seconds) 2020-07-23 07:07:19,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:07:29 UTC)" (scheduled at 2020-07-23 07:07:19.911177+00:00) 2020-07-23 07:07:19,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:07:19,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 7, 19, 913092), True, datetime.datetime(2020, 7, 23, 7, 7, 19, 913092), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:07:19,923 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:07:19,923 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:07:19,924 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:07:29 UTC)" executed successfully builder stdout | 2020-07-23 07:07:20,506 [130] [DEBUG] [buildman.server] Writing metrics builder stdout | 2020-07-23 07:07:20,519 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds builder stdout | 2020-07-23 07:07:20,600 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:07:20,605 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:07:20,605 [130] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:07:21,742 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:07:21,742 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:28.907644+00:00 (in 7.165146 seconds) 2020-07-23 07:07:21,743 [102] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:08:21 UTC)" (scheduled at 2020-07-23 07:07:21.739118+00:00) 2020-07-23 07:07:21,743 [102] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2020-07-23 07:07:21,745 [102] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 7, 21, 743468), True, datetime.datetime(2020, 7, 23, 7, 7, 21, 743468), 0, u'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2020-07-23 07:07:21,753 [102] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2020-07-23 07:07:21,754 [102] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:07:21,754 [102] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:08:21 UTC)" executed successfully gunicorn-registry stdout | 2020-07-23 07:07:22,389 [469] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '469'} gunicorn-registry stdout | 2020-07-23 07:07:22,394 [100] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '100'} gunicorn-registry stdout | 2020-07-23 07:07:22,398 [463] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '463'} gunicorn-registry stdout | 2020-07-23 07:07:22,413 [477] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '477'} gunicorn-registry stdout | 2020-07-23 07:07:22,421 [478] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '478'} gunicorn-registry stdout | 2020-07-23 07:07:22,426 [480] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '480'} gunicorn-registry stdout | 2020-07-23 07:07:22,430 [470] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '470'} gunicorn-registry stdout | 2020-07-23 07:07:22,438 [475] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '475'} gunicorn-registry stdout | 2020-07-23 07:07:22,441 [476] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '476'} gunicorn-registry stdout | 2020-07-23 07:07:22,445 [479] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '479'} gunicorn-registry stdout | 2020-07-23 07:07:22,448 [474] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '474'} gunicorn-registry stdout | 2020-07-23 07:07:22,454 [467] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '467'} gunicorn-registry stdout | 2020-07-23 07:07:22,461 [465] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '465'} gunicorn-registry stdout | 2020-07-23 07:07:22,464 [472] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '472'} gunicorn-registry stdout | 2020-07-23 07:07:22,471 [473] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '473'} gunicorn-registry stdout | 2020-07-23 07:07:22,476 [481] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '481'} gunicorn-registry stdout | 2020-07-23 07:07:22,480 [471] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '471'} gunicorn-verbs stdout | 2020-07-23 07:07:22,633 [127] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'verbs:application', 'pid': '127'} namespacegcworker stdout | 2020-07-23 07:07:23,025 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:07:23,025 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:39.024941+00:00 (in 15.999621 seconds) 2020-07-23 07:07:23,025 [134] [INFO] [apscheduler.executors.default] Running job "update_queue_metrics (trigger: interval[0:05:00], next run at: 2020-07-23 07:12:23 UTC)" (scheduled at 2020-07-23 07:07:23.024302+00:00) namespacegcworker stdout | 2020-07-23 07:07:23,028 [134] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2020, 7, 23, 7, 7, 23, 26126), u'namespacegc/%']) namespacegcworker stdout | 2020-07-23 07:07:23,037 [134] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2020, 7, 23, 7, 7, 23, 26126), True, datetime.datetime(2020, 7, 23, 7, 7, 23, 26126), 0, u'namespacegc/%']) namespacegcworker stdout | 2020-07-23 07:07:23,039 [134] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2020, 7, 23, 7, 7, 23, 26126), True, datetime.datetime(2020, 7, 23, 7, 7, 23, 26126), 0, u'namespacegc/%', False, datetime.datetime(2020, 7, 23, 7, 7, 23, 26126), u'namespacegc/%']) namespacegcworker stdout | 2020-07-23 07:07:23,041 [134] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2020-07-23 07:07:23,041 [134] [INFO] [apscheduler.executors.default] Job "update_queue_metrics (trigger: interval[0:05:00], next run at: 2020-07-23 07:12:23 UTC)" executed successfully buildlogsarchiver stdout | 2020-07-23 07:07:26,396 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:07:26,397 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:56.395393+00:00 (in 29.998537 seconds) 2020-07-23 07:07:26,397 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:07:56 UTC)" (scheduled at 2020-07-23 07:07:26.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:07:26,399 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 7, 26, 397927), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:07:26,407 [109] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2020-07-23 07:07:26,407 [109] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:07:26,407 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:07:56 UTC)" executed successfully repositoryactioncounter stdout | 2020-07-23 07:07:28,295 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:07:28,295 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:38.291018+00:00 (in 9.995598 seconds) 2020-07-23 07:07:28,296 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:07:38 UTC)" (scheduled at 2020-07-23 07:07:28.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:07:28,298 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:07:28,307 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:07:28,307 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:07:28,307 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:07:38 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:07:28,382 [419] [DEBUG] [app] Starting request: urn:request:ea2ac148-816b-460c-8b1b-ccba2d06695e (/health/instance) gunicorn-web stdout | 2020-07-23 07:07:28,385 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:07:28,390 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:07:28,394 [481] [DEBUG] [app] Starting request: urn:request:bf3ca118-94de-4463-ac0f-5e18bbdb78f7 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:07:28,397 [481] [DEBUG] [app] Ending request: urn:request:bf3ca118-94de-4463-ac0f-5e18bbdb78f7 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:28 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.008 162 0.008) gunicorn-registry stdout | 2020-07-23 07:07:28,399 [481] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:28 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:07:28,399 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:07:28,400 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:07:28,406 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:07:28,414 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:07:28,419 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:07:28,421 [438] [DEBUG] [app] Starting request: urn:request:b7298cd4-ccbb-415e-9b99-ed1a623936de (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:07:28,422 [438] [DEBUG] [app] Ending request: urn:request:b7298cd4-ccbb-415e-9b99-ed1a623936de (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:07:28,422 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:28 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:28 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:07:28,423 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:07:28,426 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:28 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:07:28,427 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:07:28,430 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:07:28,431 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:28 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:07:28,434 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:07:28,436 [460] [DEBUG] [app] Starting request: urn:request:66e574b5-bb2d-4e22-be95-c69a92e4fb8f (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:07:28,437 [460] [DEBUG] [app] Ending request: urn:request:66e574b5-bb2d-4e22-be95-c69a92e4fb8f (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:28 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 162 0.002) gunicorn-web stdout | 2020-07-23 07:07:28,438 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:07:28,438 [460] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:28 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:07:28,440 [419] [DEBUG] [app] Ending request: urn:request:ea2ac148-816b-460c-8b1b-ccba2d06695e (/health/instance) 2020-07-23 07:07:28,440 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:07:28,441 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:07:28 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:07:28 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.061 49 0.061) repositorygcworker stdout | 2020-07-23 07:07:28,908 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:07:28,909 [102] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:08:28 UTC)" (scheduled at 2020-07-23 07:07:28.907644+00:00) 2020-07-23 07:07:28,909 [102] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:07:28,909 [102] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:08:28 UTC)" executed successfully repositorygcworker stdout | 2020-07-23 07:07:28,909 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:08:21.739118+00:00 (in 52.830521 seconds) gunicorn-web stdout | 2020-07-23 07:07:29,384 [436] [DEBUG] [app] Starting request: urn:request:2a61db08-7b0d-4470-9232-895cc14813a6 (/health/instance) gunicorn-web stdout | 2020-07-23 07:07:29,387 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:07:29,392 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:07:29,396 [476] [DEBUG] [app] Starting request: urn:request:28a930fa-5e1a-4eb0-97af-a8f798962212 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:07:29,398 [476] [DEBUG] [app] Ending request: urn:request:28a930fa-5e1a-4eb0-97af-a8f798962212 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:29 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.007 162 0.007) gunicorn-registry stdout | 2020-07-23 07:07:29,399 [476] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:29 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:07:29,399 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:07:29,401 [436] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:07:29,406 [436] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:07:29,413 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:07:29,418 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:07:29,420 [438] [DEBUG] [app] Starting request: urn:request:f438517a-6332-4a0c-b343-107af96851da (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:07:29,421 [438] [DEBUG] [app] Ending request: urn:request:f438517a-6332-4a0c-b343-107af96851da (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:29 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:07:29,421 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:29 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:07:29,422 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:07:29,425 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:29 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:07:29,426 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:07:29,429 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:29 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:07:29,430 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:07:29,433 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:07:29,435 [458] [DEBUG] [app] Starting request: urn:request:ad3d2f29-461b-49f0-9ee2-12f9d4122640 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:07:29,436 [458] [DEBUG] [app] Ending request: urn:request:ad3d2f29-461b-49f0-9ee2-12f9d4122640 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:07:29,436 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:29 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 162 0.002) gunicorn-verbs stdout | 2020-07-23 07:07:29,436 [458] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:29 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:07:29,438 [436] [DEBUG] [app] Ending request: urn:request:2a61db08-7b0d-4470-9232-895cc14813a6 (/health/instance) 2020-07-23 07:07:29,439 [436] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:07:29,440 [436] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:07:29 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:07:29 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.058 49 0.058) notificationworker stdout | 2020-07-23 07:07:29,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:07:29,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:39.911177+00:00 (in 9.999064 seconds) 2020-07-23 07:07:29,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:07:39 UTC)" (scheduled at 2020-07-23 07:07:29.911177+00:00) 2020-07-23 07:07:29,912 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:07:29,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 7, 29, 913090), True, datetime.datetime(2020, 7, 23, 7, 7, 29, 913090), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:07:29,924 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:07:29,924 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:07:29,924 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:07:39 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:07:30,352 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:07:30,353 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:52.446816+00:00 (in 22.094047 seconds) 2020-07-23 07:07:30,353 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:08:00 UTC)" (scheduled at 2020-07-23 07:07:30.351857+00:00) 2020-07-23 07:07:30,353 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:07:30,355 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 7, 30, 353512), True, datetime.datetime(2020, 7, 23, 7, 7, 30, 353512), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:07:30,363 [101] [DEBUG] [workers.queueworker] No more work. security_notification_worker stdout | 2020-07-23 07:07:30,363 [101] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:07:30,363 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:08:00 UTC)" executed successfully builder stdout | 2020-07-23 07:07:30,613 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:07:30,624 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:07:30,624 [130] [DEBUG] [data.database] Disconnecting from database. securityworker stdout | 2020-07-23 07:07:33,477 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run securityworker stdout | 2020-07-23 07:07:33,477 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:08:03.476607+00:00 (in 29.999206 seconds) 2020-07-23 07:07:33,478 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:08:03 UTC)" (scheduled at 2020-07-23 07:07:33.476607+00:00) securityworker stdout | 2020-07-23 07:07:33,478 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:08:03 UTC)" executed successfully gcworker stdout | 2020-07-23 07:07:34,531 [110] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'gcworker.py', 'pid': '110'} expiredappspecifictokenworker stdout | 2020-07-23 07:07:34,891 [126] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '126'} securityworker stdout | 2020-07-23 07:07:35,529 [128] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'securityworker.py', 'pid': '128'} teamsyncworker stdout | 2020-07-23 07:07:35,879 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'teamsyncworker.py', 'pid': '115'} exportactionlogsworker stdout | 2020-07-23 07:07:37,286 [99] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'exportactionlogsworker.py', 'pid': '99'} queuecleanupworker stdout | 2020-07-23 07:07:37,684 [103] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'queuecleanupworker.py', 'pid': '103'} gunicorn-secscan stdout | 2020-07-23 07:07:37,827 [413] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '413'} gunicorn-secscan stdout | 2020-07-23 07:07:37,831 [412] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '412'} gunicorn-secscan stdout | 2020-07-23 07:07:37,836 [122] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '122'} gunicorn-secscan stdout | 2020-07-23 07:07:37,839 [414] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '414'} gunicorn-secscan stdout | 2020-07-23 07:07:37,844 [411] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '411'} repositoryactioncounter stdout | 2020-07-23 07:07:38,292 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:07:38,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:48.291018+00:00 (in 9.998663 seconds) 2020-07-23 07:07:38,293 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:07:48 UTC)" (scheduled at 2020-07-23 07:07:38.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:07:38,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:07:38,302 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:07:38,302 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:07:38,303 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:07:48 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:07:38,382 [438] [DEBUG] [app] Starting request: urn:request:5bac9477-7087-45da-bb72-b20212d2a5d2 (/health/instance) gunicorn-web stdout | 2020-07-23 07:07:38,385 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:07:38,390 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:07:38,392 [463] [DEBUG] [app] Starting request: urn:request:a5fa158a-36af-4f50-8057-14c2c6367f55 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:07:38,393 [463] [DEBUG] [app] Ending request: urn:request:a5fa158a-36af-4f50-8057-14c2c6367f55 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:07:38,394 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:38 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:07:38,394 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:38 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:07:38,395 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:07:38,401 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:07:38,408 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:07:38,413 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:07:38,415 [438] [DEBUG] [app] Starting request: urn:request:4b7def5d-6ccf-4aaa-9d66-08a0cb1afd66 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:07:38,416 [438] [DEBUG] [app] Ending request: urn:request:4b7def5d-6ccf-4aaa-9d66-08a0cb1afd66 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:07:38,416 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:38 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:38 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:07:38,417 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:07:38,421 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:38 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:07:38,422 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:07:38,426 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:38 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:07:38,427 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:07:38,432 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:07:38,434 [458] [DEBUG] [app] Starting request: urn:request:26f8765f-f73c-4472-89bc-3f9fd756e4a8 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:07:38,436 [458] [DEBUG] [app] Ending request: urn:request:26f8765f-f73c-4472-89bc-3f9fd756e4a8 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:07:38,437 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:38 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-verbs stdout | 2020-07-23 07:07:38,436 [458] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:38 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:07:38,439 [438] [DEBUG] [app] Ending request: urn:request:5bac9477-7087-45da-bb72-b20212d2a5d2 (/health/instance) 2020-07-23 07:07:38,439 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:07:38,440 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:07:38 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:07:38 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.060 49 0.060) globalpromstats stdout | 2020-07-23 07:07:38,550 [129] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'globalpromstats.py', 'pid': '129'} buildlogsarchiver stdout | 2020-07-23 07:07:38,903 [109] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'buildlogsarchiver.py', 'pid': '109'} namespacegcworker stdout | 2020-07-23 07:07:39,025 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:07:39,026 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:08:06.910005+00:00 (in 27.884201 seconds) 2020-07-23 07:07:39,026 [134] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:08:39 UTC)" (scheduled at 2020-07-23 07:07:39.024941+00:00) 2020-07-23 07:07:39,026 [134] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:07:39,026 [134] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:08:39 UTC)" executed successfully notificationworker stdout | 2020-07-23 07:07:39,151 [113] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'notificationworker.py', 'pid': '113'} chunkcleanupworker stdout | 2020-07-23 07:07:39,342 [124] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'chunkcleanupworker.py', 'pid': '124'} gunicorn-web stdout | 2020-07-23 07:07:39,384 [419] [DEBUG] [app] Starting request: urn:request:37cd3517-cb9d-4d79-af72-03f1bea40726 (/health/instance) gunicorn-web stdout | 2020-07-23 07:07:39,386 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:07:39,391 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:07:39,393 [480] [DEBUG] [app] Starting request: urn:request:f7297453-c00a-4079-88d2-3399d2eb959e (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:07:39,394 [480] [DEBUG] [app] Ending request: urn:request:f7297453-c00a-4079-88d2-3399d2eb959e (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:07:39,394 [480] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:07:39,395 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:07:39,396 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:07:39,402 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:07:39,409 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:07:39,414 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:07:39,415 [419] [DEBUG] [app] Starting request: urn:request:d3739c31-1e44-479b-96b3-fc77ab7ee7b8 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:07:39,416 [419] [DEBUG] [app] Ending request: urn:request:d3739c31-1e44-479b-96b3-fc77ab7ee7b8 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:07:39,417 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:07:39,417 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:07:39,421 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:39 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:07:39,421 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:07:39,424 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:07:39,425 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:39 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:07:39,430 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:07:39,431 [458] [DEBUG] [app] Starting request: urn:request:eef850b8-9ca9-4d95-a977-1b27b3ea9295 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:07:39,432 [458] [DEBUG] [app] Ending request: urn:request:eef850b8-9ca9-4d95-a977-1b27b3ea9295 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:39 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:07:39,433 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:07:39,433 [458] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:39 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:07:39,435 [419] [DEBUG] [app] Ending request: urn:request:37cd3517-cb9d-4d79-af72-03f1bea40726 (/health/instance) gunicorn-web stdout | 2020-07-23 07:07:39,435 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:07:39,436 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:07:39 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:07:39 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.053 49 0.053) notificationworker stdout | 2020-07-23 07:07:39,913 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:07:39,914 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:49.911177+00:00 (in 9.997072 seconds) 2020-07-23 07:07:39,914 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:07:49 UTC)" (scheduled at 2020-07-23 07:07:39.911177+00:00) 2020-07-23 07:07:39,914 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:07:39,916 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 7, 39, 914876), True, datetime.datetime(2020, 7, 23, 7, 7, 39, 914876), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:07:39,925 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:07:39,925 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:07:39,925 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:07:49 UTC)" executed successfully gcworker stdout | 2020-07-23 07:07:40,005 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2020-07-23 07:07:40,005 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:08:10.004697+00:00 (in 29.998957 seconds) 2020-07-23 07:07:40,006 [110] [INFO] [apscheduler.executors.default] Running job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:08:10 UTC)" (scheduled at 2020-07-23 07:07:40.004697+00:00) gcworker stdout | 2020-07-23 07:07:40,008 [110] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1594278460006, 1209600, 500, 1, 0]) gcworker stdout | 2020-07-23 07:07:40,018 [110] [DEBUG] [__main__] No repository with garbage found 2020-07-23 07:07:40,018 [110] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2020-07-23 07:07:40,018 [110] [INFO] [apscheduler.executors.default] Job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:08:10 UTC)" executed successfully builder stdout | 2020-07-23 07:07:40,549 [130] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'builder.py', 'pid': '130'} builder stdout | 2020-07-23 07:07:40,634 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:07:40,648 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:07:40,648 [130] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:07:40,843 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositorygcworker.py', 'pid': '102'} namespacegcworker stdout | 2020-07-23 07:07:40,848 [134] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'namespacegcworker.py', 'pid': '134'} blobuploadcleanupworker stdout | 2020-07-23 07:07:41,347 [119] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'blobuploadcleanupworker.py', 'pid': '119'} security_notification_worker stdout | 2020-07-23 07:07:42,816 [101] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'security_notification_worker.py', 'pid': '101'} logrotateworker stdout | 2020-07-23 07:07:42,888 [118] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'logrotateworker.py', 'pid': '118'} storagereplication stdout | 2020-07-23 07:07:42,909 [133] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'storagereplication.py', 'pid': '133'} repositoryactioncounter stdout | 2020-07-23 07:07:44,211 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositoryactioncounter.py', 'pid': '114'} servicekey stdout | 2020-07-23 07:07:44,858 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'servicekeyworker.py', 'pid': '98'} gunicorn-web stdout | 2020-07-23 07:07:45,690 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '104'} gunicorn-web stdout | 2020-07-23 07:07:45,701 [435] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '435'} gunicorn-web stdout | 2020-07-23 07:07:45,715 [419] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '419'} gunicorn-web stdout | 2020-07-23 07:07:45,724 [438] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '438'} gunicorn-web stdout | 2020-07-23 07:07:45,731 [433] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '433'} gunicorn-web stdout | 2020-07-23 07:07:45,735 [431] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '431'} gunicorn-web stdout | 2020-07-23 07:07:45,740 [436] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '436'} gunicorn-web stdout | 2020-07-23 07:07:45,744 [423] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '423'} gunicorn-web stdout | 2020-07-23 07:07:45,748 [420] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '420'} repositoryactioncounter stdout | 2020-07-23 07:07:48,292 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:07:48,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:58.291018+00:00 (in 9.998394 seconds) 2020-07-23 07:07:48,293 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:07:58 UTC)" (scheduled at 2020-07-23 07:07:48.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:07:48,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:07:48,304 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:07:48,304 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:07:48,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:07:58 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:07:48,382 [419] [DEBUG] [app] Starting request: urn:request:b5b29d16-ff9f-40fd-a405-beac7c9289b8 (/health/instance) gunicorn-web stdout | 2020-07-23 07:07:48,385 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:07:48,390 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:07:48,392 [481] [DEBUG] [app] Starting request: urn:request:411f34dc-34ac-4d08-a167-538c0293f386 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:07:48,393 [481] [DEBUG] [app] Ending request: urn:request:411f34dc-34ac-4d08-a167-538c0293f386 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-registry stdout | 2020-07-23 07:07:48,393 [481] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:07:48,394 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:07:48,395 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:07:48,400 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:07:48,408 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:07:48,413 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:07:48,415 [419] [DEBUG] [app] Starting request: urn:request:b1570616-efde-4df9-8956-f747ee76a00c (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:07:48,416 [419] [DEBUG] [app] Ending request: urn:request:b1570616-efde-4df9-8956-f747ee76a00c (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:48 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:07:48,417 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:48 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:07:48,417 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:07:48,421 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:48 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:07:48,421 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:07:48,424 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:07:48,426 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:48 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:07:48,429 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:07:48,431 [466] [DEBUG] [app] Starting request: urn:request:2fec1aed-8638-40aa-9ecb-c126d8855b63 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:07:48,432 [466] [DEBUG] [app] Ending request: urn:request:2fec1aed-8638-40aa-9ecb-c126d8855b63 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:07:48,433 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:48 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:07:48,433 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:48 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:07:48,434 [419] [DEBUG] [app] Ending request: urn:request:b5b29d16-ff9f-40fd-a405-beac7c9289b8 (/health/instance) 2020-07-23 07:07:48,435 [419] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:07:48 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.054 49 0.054) gunicorn-web stdout | 2020-07-23 07:07:48,435 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:07:48 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" gunicorn-web stdout | 2020-07-23 07:07:49,384 [436] [DEBUG] [app] Starting request: urn:request:11399045-7e74-4ad7-8ca2-4220cb6ed910 (/health/instance) gunicorn-web stdout | 2020-07-23 07:07:49,387 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:07:49,392 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:07:49,394 [480] [DEBUG] [app] Starting request: urn:request:5efd06eb-18fd-4cc7-b5cb-2425d76dac1d (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:07:49,395 [480] [DEBUG] [app] Ending request: urn:request:5efd06eb-18fd-4cc7-b5cb-2425d76dac1d (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:07:49,395 [480] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:49 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:49 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:07:49,396 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:07:49,397 [436] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:07:49,403 [436] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:07:49,411 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:07:49,416 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:07:49,418 [436] [DEBUG] [app] Starting request: urn:request:9b9f1850-5e39-46fb-a879-01f34887cb14 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:07:49,419 [436] [DEBUG] [app] Ending request: urn:request:9b9f1850-5e39-46fb-a879-01f34887cb14 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:07:49,419 [436] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:49 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:49 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:07:49,420 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:07:49,423 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:49 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:07:49,424 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:07:49,427 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:07:49,428 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:49 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:07:49,432 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:07:49,437 [462] [DEBUG] [app] Starting request: urn:request:fbd273d1-caec-4bdc-9d37-d1486d7a99cb (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:07:49,441 [462] [DEBUG] [app] Ending request: urn:request:fbd273d1-caec-4bdc-9d37-d1486d7a99cb (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:49 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.010 162 0.010) gunicorn-web stdout | 2020-07-23 07:07:49,443 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:07:49,442 [462] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:49 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:07:49,445 [436] [DEBUG] [app] Ending request: urn:request:11399045-7e74-4ad7-8ca2-4220cb6ed910 (/health/instance) gunicorn-web stdout | 2020-07-23 07:07:49,445 [436] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:07:49 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.063 49 0.063) gunicorn-web stdout | 2020-07-23 07:07:49,446 [436] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:07:49 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" notificationworker stdout | 2020-07-23 07:07:49,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:07:49,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:07:59.911177+00:00 (in 9.999135 seconds) 2020-07-23 07:07:49,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:07:59 UTC)" (scheduled at 2020-07-23 07:07:49.911177+00:00) 2020-07-23 07:07:49,912 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:07:49,914 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 7, 49, 912860), True, datetime.datetime(2020, 7, 23, 7, 7, 49, 912860), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:07:49,925 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:07:49,925 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:07:49,926 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:07:59 UTC)" executed successfully builder stdout | 2020-07-23 07:07:50,530 [130] [DEBUG] [buildman.server] Writing metrics builder stdout | 2020-07-23 07:07:50,543 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds builder stdout | 2020-07-23 07:07:50,650 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:07:50,656 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:07:50,657 [130] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2020-07-23 07:07:52,399 [469] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '469'} gunicorn-registry stdout | 2020-07-23 07:07:52,409 [100] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '100'} gunicorn-registry stdout | 2020-07-23 07:07:52,414 [463] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '463'} gunicorn-registry stdout | 2020-07-23 07:07:52,424 [477] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '477'} gunicorn-registry stdout | 2020-07-23 07:07:52,431 [478] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '478'} gunicorn-registry stdout | 2020-07-23 07:07:52,439 [480] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '480'} gunicorn-registry stdout | 2020-07-23 07:07:52,442 [470] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '470'} security_notification_worker stdout | 2020-07-23 07:07:52,449 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:07:52,449 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:08:00.351857+00:00 (in 7.902337 seconds) gunicorn-registry stdout | 2020-07-23 07:07:52,452 [475] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '475'} security_notification_worker stdout | 2020-07-23 07:07:52,451 [101] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:08:52 UTC)" (scheduled at 2020-07-23 07:07:52.446816+00:00) 2020-07-23 07:07:52,451 [101] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:07:52,451 [101] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:08:52 UTC)" executed successfully gunicorn-registry stdout | 2020-07-23 07:07:52,453 [476] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '476'} gunicorn-registry stdout | 2020-07-23 07:07:52,457 [479] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '479'} gunicorn-registry stdout | 2020-07-23 07:07:52,462 [474] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '474'} gunicorn-registry stdout | 2020-07-23 07:07:52,468 [467] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '467'} gunicorn-registry stdout | 2020-07-23 07:07:52,473 [465] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '465'} gunicorn-registry stdout | 2020-07-23 07:07:52,478 [472] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '472'} gunicorn-registry stdout | 2020-07-23 07:07:52,484 [473] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '473'} gunicorn-registry stdout | 2020-07-23 07:07:52,493 [471] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '471'} gunicorn-registry stdout | 2020-07-23 07:07:52,497 [481] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '481'} gunicorn-verbs stdout | 2020-07-23 07:07:52,733 [127] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'verbs:application', 'pid': '127'} buildlogsarchiver stdout | 2020-07-23 07:07:56,396 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:07:56,396 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:08:26.395393+00:00 (in 29.999080 seconds) 2020-07-23 07:07:56,396 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:08:26 UTC)" (scheduled at 2020-07-23 07:07:56.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:07:56,398 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 7, 56, 397173), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:07:56,407 [109] [DEBUG] [__main__] No more builds to archive 2020-07-23 07:07:56,407 [109] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2020-07-23 07:07:56,407 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:08:26 UTC)" executed successfully repositoryactioncounter stdout | 2020-07-23 07:07:58,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:07:58,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:08:08.291018+00:00 (in 9.998974 seconds) 2020-07-23 07:07:58,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:08:08 UTC)" (scheduled at 2020-07-23 07:07:58.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:07:58,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:07:58,304 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:07:58,304 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:07:58,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:08:08 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:07:58,382 [419] [DEBUG] [app] Starting request: urn:request:4e95eedc-6549-40e1-b943-f00111592965 (/health/instance) gunicorn-web stdout | 2020-07-23 07:07:58,385 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:07:58,391 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:07:58,395 [470] [DEBUG] [app] Starting request: urn:request:d1611bd4-cfea-4f7d-ac08-fb61e974bb1b (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:07:58,397 [470] [DEBUG] [app] Ending request: urn:request:d1611bd4-cfea-4f7d-ac08-fb61e974bb1b (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.008 162 0.008) gunicorn-web stdout | 2020-07-23 07:07:58,399 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:07:58,401 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2020-07-23 07:07:58,399 [470] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:07:58,407 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:07:58,415 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:07:58,420 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:07:58,422 [419] [DEBUG] [app] Starting request: urn:request:d6bfe7a1-2fb1-4b1f-b263-c3521c2f7037 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:07:58,423 [419] [DEBUG] [app] Ending request: urn:request:d6bfe7a1-2fb1-4b1f-b263-c3521c2f7037 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:07:58,424 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:58 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:07:58,425 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:58 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:07:58,428 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:58 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:07:58,429 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:07:58,432 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:07:58,434 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:58 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:07:58,437 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:07:58,439 [462] [DEBUG] [app] Starting request: urn:request:6b684f5f-3da9-42ec-81e0-a462317b5e4b (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:07:58,440 [462] [DEBUG] [app] Ending request: urn:request:6b684f5f-3da9-42ec-81e0-a462317b5e4b (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:58 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:07:58,441 [462] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:58 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:07:58,442 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:07:58,444 [419] [DEBUG] [app] Ending request: urn:request:4e95eedc-6549-40e1-b943-f00111592965 (/health/instance) gunicorn-web stdout | 2020-07-23 07:07:58,444 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:07:58,445 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:07:58 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:07:58 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.065 49 0.065) gunicorn-web stdout | 2020-07-23 07:07:59,384 [438] [DEBUG] [app] Starting request: urn:request:e1306674-fe79-4b6e-9f93-a36ec128df92 (/health/instance) gunicorn-web stdout | 2020-07-23 07:07:59,387 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:07:59,392 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:07:59,394 [480] [DEBUG] [app] Starting request: urn:request:10e86621-0676-463c-8bc8-280b2d89c9fc (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:07:59,395 [480] [DEBUG] [app] Ending request: urn:request:10e86621-0676-463c-8bc8-280b2d89c9fc (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:59 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:07:59,396 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:07:59,397 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2020-07-23 07:07:59,398 [480] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:59 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:07:59,403 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:07:59,411 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:07:59,416 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:07:59,418 [438] [DEBUG] [app] Starting request: urn:request:4f9016fc-97d2-4ea4-b225-1e97da052f23 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:07:59,419 [438] [DEBUG] [app] Ending request: urn:request:4f9016fc-97d2-4ea4-b225-1e97da052f23 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:07:59,420 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:59 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:59 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 159 0.002) gunicorn-web stdout | 2020-07-23 07:07:59,420 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:07:59,424 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:59 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:07:59,425 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:07:59,428 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:59 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:07:59,429 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:07:59,433 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:07:59,435 [458] [DEBUG] [app] Starting request: urn:request:cfa8505b-05cb-4171-ae65-5e46a8f95a55 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:07:59,436 [458] [DEBUG] [app] Ending request: urn:request:cfa8505b-05cb-4171-ae65-5e46a8f95a55 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:07:59,437 [458] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:07:59 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:07:59 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:07:59,439 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:07:59,441 [438] [DEBUG] [app] Ending request: urn:request:e1306674-fe79-4b6e-9f93-a36ec128df92 (/health/instance) gunicorn-web stdout | 2020-07-23 07:07:59,441 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:07:59,442 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:07:59 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:07:59 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.059 49 0.059) notificationworker stdout | 2020-07-23 07:07:59,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:07:59,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:08:09 UTC)" (scheduled at 2020-07-23 07:07:59.911177+00:00) 2020-07-23 07:07:59,912 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:07:59,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 7, 59, 912913), True, datetime.datetime(2020, 7, 23, 7, 7, 59, 912913), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:07:59,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:08:09.911177+00:00 (in 9.999112 seconds) notificationworker stdout | 2020-07-23 07:07:59,925 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:07:59,925 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:07:59,925 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:08:09 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:08:00,352 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:08:00,353 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:08:30.351857+00:00 (in 29.999099 seconds) 2020-07-23 07:08:00,353 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:08:30 UTC)" (scheduled at 2020-07-23 07:08:00.351857+00:00) 2020-07-23 07:08:00,353 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:08:00,355 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 8, 0, 353679), True, datetime.datetime(2020, 7, 23, 7, 8, 0, 353679), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:08:00,364 [101] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:08:00,364 [101] [DEBUG] [data.database] Disconnecting from database. security_notification_worker stdout | 2020-07-23 07:08:00,365 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:08:30 UTC)" executed successfully builder stdout | 2020-07-23 07:08:00,665 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:08:00,678 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:08:00,678 [130] [DEBUG] [data.database] Disconnecting from database. securityworker stdout | 2020-07-23 07:08:03,478 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run securityworker stdout | 2020-07-23 07:08:03,478 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:08:03 UTC)" (scheduled at 2020-07-23 07:08:03.476607+00:00) securityworker stdout | 2020-07-23 07:08:03,479 [128] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "image" AS "t1" WHERE ("t1"."security_indexed_engine" < %s)', [3]) securityworker stdout | 2020-07-23 07:08:03,480 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:08:33.476607+00:00 (in 29.998183 seconds) securityworker stdout | 2020-07-23 07:08:03,486 [128] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "image" AS "t1"', []) securityworker stdout | 2020-07-23 07:08:03,487 [128] [DEBUG] [data.secscan_model.secscan_v2_model] Found no additional images to scan 2020-07-23 07:08:03,487 [128] [DEBUG] [data.database] Disconnecting from database. securityworker stdout | 2020-07-23 07:08:03,488 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:08:33 UTC)" executed successfully exportactionlogsworker stdout | 2020-07-23 07:08:03,972 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:08:03,973 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:08:08.212267+00:00 (in 4.239483 seconds) 2020-07-23 07:08:03,973 [99] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:09:03 UTC)" (scheduled at 2020-07-23 07:08:03.971686+00:00) 2020-07-23 07:08:03,973 [99] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2020-07-23 07:08:03,975 [99] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 8, 3, 973517), True, datetime.datetime(2020, 7, 23, 7, 8, 3, 973517), 0, u'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2020-07-23 07:08:03,984 [99] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2020-07-23 07:08:03,985 [99] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:08:03,985 [99] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:09:03 UTC)" executed successfully gcworker stdout | 2020-07-23 07:08:04,566 [110] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'gcworker.py', 'pid': '110'} expiredappspecifictokenworker stdout | 2020-07-23 07:08:04,930 [126] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '126'} securityworker stdout | 2020-07-23 07:08:05,569 [128] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'securityworker.py', 'pid': '128'} teamsyncworker stdout | 2020-07-23 07:08:05,900 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'teamsyncworker.py', 'pid': '115'} namespacegcworker stdout | 2020-07-23 07:08:06,910 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:08:06,911 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:08:39.024941+00:00 (in 32.113704 seconds) 2020-07-23 07:08:06,911 [134] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:09:06 UTC)" (scheduled at 2020-07-23 07:08:06.910005+00:00) 2020-07-23 07:08:06,912 [134] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2020-07-23 07:08:06,914 [134] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 8, 6, 912212), True, datetime.datetime(2020, 7, 23, 7, 8, 6, 912212), 0, u'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2020-07-23 07:08:06,926 [134] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2020-07-23 07:08:06,926 [134] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:08:06,927 [134] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:09:06 UTC)" executed successfully exportactionlogsworker stdout | 2020-07-23 07:08:07,326 [99] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'exportactionlogsworker.py', 'pid': '99'} queuecleanupworker stdout | 2020-07-23 07:08:07,720 [103] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'queuecleanupworker.py', 'pid': '103'} gunicorn-secscan stdout | 2020-07-23 07:08:07,837 [413] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '413'} gunicorn-secscan stdout | 2020-07-23 07:08:07,843 [412] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '412'} gunicorn-secscan stdout | 2020-07-23 07:08:07,849 [122] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '122'} gunicorn-secscan stdout | 2020-07-23 07:08:07,855 [411] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '411'} gunicorn-secscan stdout | 2020-07-23 07:08:07,859 [414] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '414'} exportactionlogsworker stdout | 2020-07-23 07:08:08,212 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:08:08,213 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:03.971686+00:00 (in 55.758498 seconds) 2020-07-23 07:08:08,213 [99] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:09:08 UTC)" (scheduled at 2020-07-23 07:08:08.212267+00:00) 2020-07-23 07:08:08,213 [99] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:08:08,214 [99] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:09:08 UTC)" executed successfully repositoryactioncounter stdout | 2020-07-23 07:08:08,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:08:08,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:08:18 UTC)" (scheduled at 2020-07-23 07:08:08.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:08:08,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:08:18.291018+00:00 (in 9.998907 seconds) repositoryactioncounter stdout | 2020-07-23 07:08:08,296 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:08:08,305 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:08:08,305 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:08:08,305 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:08:18 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:08:08,383 [419] [DEBUG] [app] Starting request: urn:request:4f5ac183-71f0-4d64-8686-d0643167ba08 (/health/instance) gunicorn-web stdout | 2020-07-23 07:08:08,385 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:08:08,391 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:08:08,393 [463] [DEBUG] [app] Starting request: urn:request:d6cf7baf-c17c-49db-94b4-32a59f9f025d (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:08:08,394 [463] [DEBUG] [app] Ending request: urn:request:d6cf7baf-c17c-49db-94b4-32a59f9f025d (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:08:08,395 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:08 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:08 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:08:08,395 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:08:08,396 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:08:08,402 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:08:08,411 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:08:08,417 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:08:08,419 [419] [DEBUG] [app] Starting request: urn:request:37746a9d-2168-45a6-aea3-4d7a6f331f5f (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:08:08,420 [419] [DEBUG] [app] Ending request: urn:request:37746a9d-2168-45a6-aea3-4d7a6f331f5f (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:08 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:08:08,421 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:08 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:08:08,422 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:08:08,426 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:08 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:08:08,426 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:08:08,430 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:08 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:08:08,431 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:08:08,435 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:08:08,437 [458] [DEBUG] [app] Starting request: urn:request:6a9275dc-868d-469b-a26e-33ebc87dada0 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:08:08,439 [458] [DEBUG] [app] Ending request: urn:request:6a9275dc-868d-469b-a26e-33ebc87dada0 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:08:08,439 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:08 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:08:08,441 [419] [DEBUG] [app] Ending request: urn:request:4f5ac183-71f0-4d64-8686-d0643167ba08 (/health/instance) 2020-07-23 07:08:08,442 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:08:08,442 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:08:08 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:08:08 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.062 49 0.062) gunicorn-verbs stdout | 2020-07-23 07:08:08,443 [458] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:08 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" globalpromstats stdout | 2020-07-23 07:08:08,590 [129] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'globalpromstats.py', 'pid': '129'} buildlogsarchiver stdout | 2020-07-23 07:08:08,941 [109] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'buildlogsarchiver.py', 'pid': '109'} notificationworker stdout | 2020-07-23 07:08:09,184 [113] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'notificationworker.py', 'pid': '113'} chunkcleanupworker stdout | 2020-07-23 07:08:09,376 [124] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'chunkcleanupworker.py', 'pid': '124'} gunicorn-web stdout | 2020-07-23 07:08:09,384 [438] [DEBUG] [app] Starting request: urn:request:6578fdc2-9d6c-4b4c-a11e-ebe26e3cfa68 (/health/instance) gunicorn-web stdout | 2020-07-23 07:08:09,386 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:08:09,391 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:08:09,395 [478] [DEBUG] [app] Starting request: urn:request:77426723-026a-44c5-bb1a-8c5d1b5daa26 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:08:09,398 [478] [DEBUG] [app] Ending request: urn:request:77426723-026a-44c5-bb1a-8c5d1b5daa26 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.008 162 0.008) gunicorn-registry stdout | 2020-07-23 07:08:09,400 [478] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:08:09,400 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:08:09,401 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:08:09,406 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:08:09,413 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:08:09,418 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:08:09,420 [438] [DEBUG] [app] Starting request: urn:request:1291f2b7-ce32-4cd5-8a92-741ad6a62c72 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:08:09,420 [438] [DEBUG] [app] Ending request: urn:request:1291f2b7-ce32-4cd5-8a92-741ad6a62c72 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:08:09,421 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:08:09,422 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:08:09,425 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:08:09,426 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:09 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:08:09,428 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:09 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:08:09,430 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:08:09,434 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:08:09,435 [462] [DEBUG] [app] Starting request: urn:request:6e2d8b39-c902-481a-b178-f955d931ca3a (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:09 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:08:09,436 [462] [DEBUG] [app] Ending request: urn:request:6e2d8b39-c902-481a-b178-f955d931ca3a (/c1/_internal_ping) 2020-07-23 07:08:09,437 [462] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:09 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:08:09,437 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:08:09,439 [438] [DEBUG] [app] Ending request: urn:request:6578fdc2-9d6c-4b4c-a11e-ebe26e3cfa68 (/health/instance) gunicorn-web stdout | 2020-07-23 07:08:09,439 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:08:09,440 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:08:09 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:08:09 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.058 49 0.058) notificationworker stdout | 2020-07-23 07:08:09,915 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:08:09,916 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:08:11.998621+00:00 (in 2.082881 seconds) 2020-07-23 07:08:09,916 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:08:19 UTC)" (scheduled at 2020-07-23 07:08:09.911177+00:00) 2020-07-23 07:08:09,916 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:08:09,919 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 8, 9, 916778), True, datetime.datetime(2020, 7, 23, 7, 8, 9, 916778), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:08:09,929 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:08:09,929 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:08:09,930 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:08:19 UTC)" executed successfully gcworker stdout | 2020-07-23 07:08:10,005 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2020-07-23 07:08:10,005 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:08:40.004697+00:00 (in 29.999245 seconds) 2020-07-23 07:08:10,006 [110] [INFO] [apscheduler.executors.default] Running job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:08:40 UTC)" (scheduled at 2020-07-23 07:08:10.004697+00:00) gcworker stdout | 2020-07-23 07:08:10,008 [110] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1594278490006, 1209600, 500, 1, 0]) gcworker stdout | 2020-07-23 07:08:10,018 [110] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2020-07-23 07:08:10,019 [110] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:08:10,019 [110] [INFO] [apscheduler.executors.default] Job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:08:40 UTC)" executed successfully builder stdout | 2020-07-23 07:08:10,589 [130] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'builder.py', 'pid': '130'} builder stdout | 2020-07-23 07:08:10,688 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:08:10,704 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:08:10,704 [130] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:08:10,881 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositorygcworker.py', 'pid': '102'} namespacegcworker stdout | 2020-07-23 07:08:10,887 [134] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'namespacegcworker.py', 'pid': '134'} blobuploadcleanupworker stdout | 2020-07-23 07:08:11,388 [119] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'blobuploadcleanupworker.py', 'pid': '119'} notificationworker stdout | 2020-07-23 07:08:11,999 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:08:12,000 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:08:19.911177+00:00 (in 7.911445 seconds) 2020-07-23 07:08:12,000 [113] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:09:11 UTC)" (scheduled at 2020-07-23 07:08:11.998621+00:00) 2020-07-23 07:08:12,000 [113] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:08:12,000 [113] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:09:11 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:08:12,855 [101] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'security_notification_worker.py', 'pid': '101'} logrotateworker stdout | 2020-07-23 07:08:12,927 [118] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'logrotateworker.py', 'pid': '118'} storagereplication stdout | 2020-07-23 07:08:12,946 [133] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'storagereplication.py', 'pid': '133'} repositoryactioncounter stdout | 2020-07-23 07:08:14,253 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositoryactioncounter.py', 'pid': '114'} servicekey stdout | 2020-07-23 07:08:14,891 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'servicekeyworker.py', 'pid': '98'} gunicorn-web stdout | 2020-07-23 07:08:15,701 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '104'} gunicorn-web stdout | 2020-07-23 07:08:15,712 [435] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '435'} gunicorn-web stdout | 2020-07-23 07:08:15,729 [419] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '419'} gunicorn-web stdout | 2020-07-23 07:08:15,736 [438] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '438'} gunicorn-web stdout | 2020-07-23 07:08:15,742 [433] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '433'} gunicorn-web stdout | 2020-07-23 07:08:15,745 [431] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '431'} gunicorn-web stdout | 2020-07-23 07:08:15,752 [436] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '436'} gunicorn-web stdout | 2020-07-23 07:08:15,757 [420] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '420'} gunicorn-web stdout | 2020-07-23 07:08:15,762 [423] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '423'} repositoryactioncounter stdout | 2020-07-23 07:08:18,295 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:08:18,296 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:08:28 UTC)" (scheduled at 2020-07-23 07:08:18.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:08:18,297 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:08:18,298 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:08:28.291018+00:00 (in 9.995545 seconds) repositoryactioncounter stdout | 2020-07-23 07:08:18,306 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:08:18,308 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:08:18,308 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:08:28 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:08:18,382 [419] [DEBUG] [app] Starting request: urn:request:7dbc9a7d-479e-40b1-9a66-0cf01074ac4b (/health/instance) gunicorn-web stdout | 2020-07-23 07:08:18,385 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:08:18,391 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:08:18,395 [473] [DEBUG] [app] Starting request: urn:request:9db4f57e-8527-4157-8dcf-291e8e17e0bc (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:08:18,398 [473] [DEBUG] [app] Ending request: urn:request:9db4f57e-8527-4157-8dcf-291e8e17e0bc (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:18 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.008 162 0.008) gunicorn-registry stdout | 2020-07-23 07:08:18,399 [473] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:18 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:08:18,399 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:08:18,401 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:08:18,407 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:08:18,415 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:08:18,419 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:08:18,421 [438] [DEBUG] [app] Starting request: urn:request:0cbdc9fd-42b8-4e25-bb56-8640b94ea313 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:08:18,422 [438] [DEBUG] [app] Ending request: urn:request:0cbdc9fd-42b8-4e25-bb56-8640b94ea313 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:08:18,423 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:18 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:08:18,423 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:18 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:08:18,427 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:08:18,428 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:18 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:08:18,432 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:08:18,433 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:18 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:08:18,437 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:08:18,438 [462] [DEBUG] [app] Starting request: urn:request:f4fd3f33-e921-4cbe-88f5-83c366315615 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:08:18,439 [462] [DEBUG] [app] Ending request: urn:request:f4fd3f33-e921-4cbe-88f5-83c366315615 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:08:18,440 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:18 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 162 0.002) gunicorn-verbs stdout | 2020-07-23 07:08:18,440 [462] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:18 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:08:18,442 [419] [DEBUG] [app] Ending request: urn:request:7dbc9a7d-479e-40b1-9a66-0cf01074ac4b (/health/instance) 2020-07-23 07:08:18,442 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:08:18,443 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:08:18 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:08:18 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.063 49 0.063) gunicorn-web stdout | 2020-07-23 07:08:19,384 [419] [DEBUG] [app] Starting request: urn:request:2d429057-06de-40bb-8b12-3cc000783238 (/health/instance) gunicorn-web stdout | 2020-07-23 07:08:19,388 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:08:19,390 [463] [DEBUG] [app] Starting request: urn:request:7b9e61bc-151b-4c24-9e5c-6c262da103bd (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:08:19,391 [463] [DEBUG] [app] Ending request: urn:request:7b9e61bc-151b-4c24-9e5c-6c262da103bd (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:08:19,392 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:19 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:19 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:08:19,393 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:08:19,394 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:08:19,400 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:08:19,408 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:08:19,414 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:08:19,415 [419] [DEBUG] [app] Starting request: urn:request:def7fd84-3c8e-4bf3-a528-aa7649f3b714 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:08:19,416 [419] [DEBUG] [app] Ending request: urn:request:def7fd84-3c8e-4bf3-a528-aa7649f3b714 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:19 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:08:19,417 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:19 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:08:19,418 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:08:19,422 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:19 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:08:19,423 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:08:19,426 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:08:19,428 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:19 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:08:19,431 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:08:19,433 [462] [DEBUG] [app] Starting request: urn:request:239ed776-ecc0-486d-925d-e0135c5c7aa7 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:08:19,435 [462] [DEBUG] [app] Ending request: urn:request:239ed776-ecc0-486d-925d-e0135c5c7aa7 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:08:19,436 [462] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:19 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:19 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:08:19,437 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:08:19,439 [419] [DEBUG] [app] Ending request: urn:request:2d429057-06de-40bb-8b12-3cc000783238 (/health/instance) gunicorn-web stdout | 2020-07-23 07:08:19,439 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:08:19,440 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:08:19 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:08:19 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.057 49 0.057) notificationworker stdout | 2020-07-23 07:08:19,912 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:08:19,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:08:29 UTC)" (scheduled at 2020-07-23 07:08:19.911177+00:00) 2020-07-23 07:08:19,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:08:19,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:08:29.911177+00:00 (in 9.998892 seconds) notificationworker stdout | 2020-07-23 07:08:19,916 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 8, 19, 913303), True, datetime.datetime(2020, 7, 23, 7, 8, 19, 913303), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:08:19,927 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:08:19,927 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:08:19,927 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:08:29 UTC)" executed successfully builder stdout | 2020-07-23 07:08:20,554 [130] [DEBUG] [buildman.server] Writing metrics builder stdout | 2020-07-23 07:08:20,569 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds builder stdout | 2020-07-23 07:08:20,706 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:08:20,711 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:08:20,712 [130] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:08:21,740 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:08:21,741 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:08:28.907644+00:00 (in 7.166521 seconds) 2020-07-23 07:08:21,741 [102] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:09:21 UTC)" (scheduled at 2020-07-23 07:08:21.739118+00:00) 2020-07-23 07:08:21,742 [102] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2020-07-23 07:08:21,744 [102] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 8, 21, 742232), True, datetime.datetime(2020, 7, 23, 7, 8, 21, 742232), 0, u'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2020-07-23 07:08:21,753 [102] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:08:21,754 [102] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:08:21,754 [102] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:09:21 UTC)" executed successfully gunicorn-registry stdout | 2020-07-23 07:08:22,410 [469] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '469'} gunicorn-registry stdout | 2020-07-23 07:08:22,424 [100] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '100'} gunicorn-registry stdout | 2020-07-23 07:08:22,429 [463] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '463'} gunicorn-registry stdout | 2020-07-23 07:08:22,435 [477] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '477'} gunicorn-registry stdout | 2020-07-23 07:08:22,442 [478] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '478'} gunicorn-registry stdout | 2020-07-23 07:08:22,457 [470] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '470'} gunicorn-registry stdout | 2020-07-23 07:08:22,462 [480] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '480'} gunicorn-registry stdout | 2020-07-23 07:08:22,465 [476] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '476'} gunicorn-registry stdout | 2020-07-23 07:08:22,472 [475] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '475'} gunicorn-registry stdout | 2020-07-23 07:08:22,486 [467] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '467'} gunicorn-registry stdout | 2020-07-23 07:08:22,493 [479] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '479'} gunicorn-registry stdout | 2020-07-23 07:08:22,497 [474] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '474'} gunicorn-registry stdout | 2020-07-23 07:08:22,502 [472] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '472'} gunicorn-registry stdout | 2020-07-23 07:08:22,507 [465] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '465'} gunicorn-registry stdout | 2020-07-23 07:08:22,511 [473] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '473'} gunicorn-registry stdout | 2020-07-23 07:08:22,514 [471] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '471'} gunicorn-registry stdout | 2020-07-23 07:08:22,518 [481] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '481'} gunicorn-verbs stdout | 2020-07-23 07:08:22,842 [127] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'verbs:application', 'pid': '127'} buildlogsarchiver stdout | 2020-07-23 07:08:26,396 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:08:26,396 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:08:56.395393+00:00 (in 29.998878 seconds) 2020-07-23 07:08:26,397 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:08:56 UTC)" (scheduled at 2020-07-23 07:08:26.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:08:26,399 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 8, 26, 397293), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:08:26,407 [109] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2020-07-23 07:08:26,407 [109] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:08:26,407 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:08:56 UTC)" executed successfully repositoryactioncounter stdout | 2020-07-23 07:08:28,294 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:08:28,295 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:08:38.291018+00:00 (in 9.996218 seconds) 2020-07-23 07:08:28,295 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:08:38 UTC)" (scheduled at 2020-07-23 07:08:28.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:08:28,297 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:08:28,306 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:08:28,306 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:08:28,307 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:08:38 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:08:28,382 [438] [DEBUG] [app] Starting request: urn:request:9b06f041-ff06-484c-9c81-d92048ccb657 (/health/instance) gunicorn-web stdout | 2020-07-23 07:08:28,385 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:08:28,391 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:08:28,393 [463] [DEBUG] [app] Starting request: urn:request:cf329cab-bc20-4c68-b0fc-eee3be7cc0ee (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:08:28,394 [463] [DEBUG] [app] Ending request: urn:request:cf329cab-bc20-4c68-b0fc-eee3be7cc0ee (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:08:28,395 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:28 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:28 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:08:28,395 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:08:28,396 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:08:28,402 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:08:28,411 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:08:28,416 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:08:28,418 [438] [DEBUG] [app] Starting request: urn:request:400c03ad-37c2-48eb-9baf-bc3b0a313ab5 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:08:28,419 [438] [DEBUG] [app] Ending request: urn:request:400c03ad-37c2-48eb-9baf-bc3b0a313ab5 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:08:28,420 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:28 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:28 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:08:28,421 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:08:28,425 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:28 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:08:28,425 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:08:28,428 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:08:28,430 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:28 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:08:28,435 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:08:28,436 [462] [DEBUG] [app] Starting request: urn:request:283ba950-8a32-42bd-91fe-2b7245c6c26c (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:28 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:08:28,437 [462] [DEBUG] [app] Ending request: urn:request:283ba950-8a32-42bd-91fe-2b7245c6c26c (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:08:28,438 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:08:28,438 [462] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:28 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:08:28,440 [438] [DEBUG] [app] Ending request: urn:request:9b06f041-ff06-484c-9c81-d92048ccb657 (/health/instance) 2020-07-23 07:08:28,440 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:08:28,441 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:08:28 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:08:28 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.061 49 0.061) repositorygcworker stdout | 2020-07-23 07:08:28,908 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:08:28,909 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:21.739118+00:00 (in 52.830447 seconds) 2020-07-23 07:08:28,909 [102] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:09:28 UTC)" (scheduled at 2020-07-23 07:08:28.907644+00:00) 2020-07-23 07:08:28,909 [102] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:08:28,909 [102] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:09:28 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:08:29,385 [419] [DEBUG] [app] Starting request: urn:request:8cf36e4b-813a-4872-9aa6-52d842f260cd (/health/instance) gunicorn-web stdout | 2020-07-23 07:08:29,388 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:08:29,395 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:08:29,397 [480] [DEBUG] [app] Starting request: urn:request:5983ed1c-deea-43c4-aaea-b499ca43773f (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:08:29,398 [480] [DEBUG] [app] Ending request: urn:request:5983ed1c-deea-43c4-aaea-b499ca43773f (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:29 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:08:29,399 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:08:29,401 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2020-07-23 07:08:29,401 [480] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:29 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:08:29,408 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:08:29,416 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:08:29,422 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:08:29,424 [419] [DEBUG] [app] Starting request: urn:request:52796669-5cac-46fa-b071-d79a95d3fe1d (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:08:29,425 [419] [DEBUG] [app] Ending request: urn:request:52796669-5cac-46fa-b071-d79a95d3fe1d (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:08:29,426 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:29 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:29 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:08:29,427 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:08:29,431 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:29 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:08:29,432 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:08:29,436 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:29 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:08:29,437 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:08:29,441 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:08:29,443 [462] [DEBUG] [app] Starting request: urn:request:3ee7db18-533f-4ea4-a230-49117f30dfcb (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:08:29,445 [462] [DEBUG] [app] Ending request: urn:request:3ee7db18-533f-4ea4-a230-49117f30dfcb (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:08:29,445 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:29 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:08:29,445 [462] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:29 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:08:29,448 [419] [DEBUG] [app] Ending request: urn:request:8cf36e4b-813a-4872-9aa6-52d842f260cd (/health/instance) gunicorn-web stdout | 2020-07-23 07:08:29,448 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:08:29,449 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:08:29 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:08:29 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.066 49 0.066) notificationworker stdout | 2020-07-23 07:08:29,915 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:08:29,916 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:08:39.911177+00:00 (in 9.995341 seconds) 2020-07-23 07:08:29,916 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:08:39 UTC)" (scheduled at 2020-07-23 07:08:29.911177+00:00) 2020-07-23 07:08:29,916 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:08:29,919 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 8, 29, 916899), True, datetime.datetime(2020, 7, 23, 7, 8, 29, 916899), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:08:29,926 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:08:29,927 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:08:29,927 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:08:39 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:08:30,352 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:08:30,353 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:08:52.446816+00:00 (in 22.093677 seconds) 2020-07-23 07:08:30,353 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:09:00 UTC)" (scheduled at 2020-07-23 07:08:30.351857+00:00) 2020-07-23 07:08:30,353 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:08:30,356 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 8, 30, 354074), True, datetime.datetime(2020, 7, 23, 7, 8, 30, 354074), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:08:30,365 [101] [DEBUG] [workers.queueworker] No more work. security_notification_worker stdout | 2020-07-23 07:08:30,365 [101] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:08:30,366 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:09:00 UTC)" executed successfully builder stdout | 2020-07-23 07:08:30,721 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:08:30,733 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:08:30,734 [130] [DEBUG] [data.database] Disconnecting from database. securityworker stdout | 2020-07-23 07:08:33,479 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run securityworker stdout | 2020-07-23 07:08:33,480 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:09:03 UTC)" (scheduled at 2020-07-23 07:08:33.476607+00:00) securityworker stdout | 2020-07-23 07:08:33,480 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:09:03 UTC)" executed successfully 2020-07-23 07:08:33,480 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:03.476607+00:00 (in 29.996878 seconds) gcworker stdout | 2020-07-23 07:08:34,602 [110] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'gcworker.py', 'pid': '110'} expiredappspecifictokenworker stdout | 2020-07-23 07:08:34,968 [126] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '126'} securityworker stdout | 2020-07-23 07:08:35,607 [128] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'securityworker.py', 'pid': '128'} teamsyncworker stdout | 2020-07-23 07:08:35,926 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'teamsyncworker.py', 'pid': '115'} exportactionlogsworker stdout | 2020-07-23 07:08:37,364 [99] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'exportactionlogsworker.py', 'pid': '99'} queuecleanupworker stdout | 2020-07-23 07:08:37,753 [103] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'queuecleanupworker.py', 'pid': '103'} gunicorn-secscan stdout | 2020-07-23 07:08:37,848 [413] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '413'} gunicorn-secscan stdout | 2020-07-23 07:08:37,858 [412] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '412'} gunicorn-secscan stdout | 2020-07-23 07:08:37,867 [122] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '122'} gunicorn-secscan stdout | 2020-07-23 07:08:37,872 [411] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '411'} gunicorn-secscan stdout | 2020-07-23 07:08:37,876 [414] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '414'} repositoryactioncounter stdout | 2020-07-23 07:08:38,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:08:38,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:08:48.291018+00:00 (in 9.999122 seconds) 2020-07-23 07:08:38,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:08:48 UTC)" (scheduled at 2020-07-23 07:08:38.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:08:38,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:08:38,303 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:08:38,303 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:08:38,303 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:08:48 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:08:38,383 [419] [DEBUG] [app] Starting request: urn:request:d13b3e86-d3dc-4d06-91c5-14138fdb8878 (/health/instance) gunicorn-web stdout | 2020-07-23 07:08:38,386 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:08:38,391 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:08:38,394 [463] [DEBUG] [app] Starting request: urn:request:04ba0079-0d2d-4fba-b229-ddafc99db48b (/v1/_internal_ping) 2020-07-23 07:08:38,395 [463] [DEBUG] [app] Ending request: urn:request:04ba0079-0d2d-4fba-b229-ddafc99db48b (/v1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:08:38,396 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 2020-07-23 07:08:38,398 [419] [INFO] [data.database] Connection pooling disabled for postgresql nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:38 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-registry stdout | 2020-07-23 07:08:38,401 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:38 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:08:38,404 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:08:38,412 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:08:38,417 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:08:38,419 [419] [DEBUG] [app] Starting request: urn:request:4c5c0f39-70a0-4b0a-b5ec-a4071a93933a (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:08:38,420 [419] [DEBUG] [app] Ending request: urn:request:4c5c0f39-70a0-4b0a-b5ec-a4071a93933a (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:08:38,421 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:38 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:38 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:08:38,422 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:08:38,427 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:38 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:08:38,428 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:08:38,432 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:38 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:08:38,433 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:08:38,437 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:08:38,439 [466] [DEBUG] [app] Starting request: urn:request:9f41912b-4364-4f28-9fbf-c6d791bfebc2 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:08:38,441 [466] [DEBUG] [app] Ending request: urn:request:9f41912b-4364-4f28-9fbf-c6d791bfebc2 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:38 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:08:38,441 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:38 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:08:38,442 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:08:38,444 [419] [DEBUG] [app] Ending request: urn:request:d13b3e86-d3dc-4d06-91c5-14138fdb8878 (/health/instance) 2020-07-23 07:08:38,444 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:08:38,445 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:08:38 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:08:38 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.064 49 0.064) globalpromstats stdout | 2020-07-23 07:08:38,624 [129] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'globalpromstats.py', 'pid': '129'} buildlogsarchiver stdout | 2020-07-23 07:08:38,980 [109] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'buildlogsarchiver.py', 'pid': '109'} namespacegcworker stdout | 2020-07-23 07:08:39,025 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:08:39,026 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:06.910005+00:00 (in 27.883826 seconds) 2020-07-23 07:08:39,026 [134] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:09:39 UTC)" (scheduled at 2020-07-23 07:08:39.024941+00:00) namespacegcworker stdout | 2020-07-23 07:08:39,027 [134] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:08:39,027 [134] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:09:39 UTC)" executed successfully notificationworker stdout | 2020-07-23 07:08:39,227 [113] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'notificationworker.py', 'pid': '113'} gunicorn-web stdout | 2020-07-23 07:08:39,384 [438] [DEBUG] [app] Starting request: urn:request:6589f9ef-fc12-440a-8cee-62f0e987f364 (/health/instance) gunicorn-web stdout | 2020-07-23 07:08:39,387 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:08:39,392 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:08:39,397 [465] [DEBUG] [app] Starting request: urn:request:590e4862-0494-41dc-8621-eb378520d16d (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:08:39,401 [465] [DEBUG] [app] Ending request: urn:request:590e4862-0494-41dc-8621-eb378520d16d (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.008 162 0.008) gunicorn-registry stdout | 2020-07-23 07:08:39,402 [465] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:08:39,402 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:08:39,404 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:08:39,410 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) chunkcleanupworker stdout | 2020-07-23 07:08:39,417 [124] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'chunkcleanupworker.py', 'pid': '124'} gunicorn-web stdout | 2020-07-23 07:08:39,420 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:08:39,425 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:08:39,427 [438] [DEBUG] [app] Starting request: urn:request:c0b1d5a4-8bc9-4ccf-ac49-058cac26d6c4 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:08:39,428 [438] [DEBUG] [app] Ending request: urn:request:c0b1d5a4-8bc9-4ccf-ac49-058cac26d6c4 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:08:39,429 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:08:39,430 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:08:39,434 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:39 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:08:39,435 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:08:39,438 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:08:39,439 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:39 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:08:39,444 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:08:39,445 [466] [DEBUG] [app] Starting request: urn:request:7e45d3d2-d80e-4dc3-96ab-9f1033ea8e81 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:08:39,446 [466] [DEBUG] [app] Ending request: urn:request:7e45d3d2-d80e-4dc3-96ab-9f1033ea8e81 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:39 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:08:39,447 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:39 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:08:39,447 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:08:39,449 [438] [DEBUG] [app] Ending request: urn:request:6589f9ef-fc12-440a-8cee-62f0e987f364 (/health/instance) 2020-07-23 07:08:39,449 [438] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:08:39 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.068 49 0.068) gunicorn-web stdout | 2020-07-23 07:08:39,450 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:08:39 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" notificationworker stdout | 2020-07-23 07:08:39,912 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:08:39,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:08:49.911177+00:00 (in 9.998894 seconds) 2020-07-23 07:08:39,913 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:08:49 UTC)" (scheduled at 2020-07-23 07:08:39.911177+00:00) 2020-07-23 07:08:39,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:08:39,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 8, 39, 913365), True, datetime.datetime(2020, 7, 23, 7, 8, 39, 913365), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:08:39,924 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:08:39,924 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:08:39,924 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:08:49 UTC)" executed successfully gcworker stdout | 2020-07-23 07:08:40,005 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2020-07-23 07:08:40,006 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:10.004697+00:00 (in 29.998988 seconds) 2020-07-23 07:08:40,006 [110] [INFO] [apscheduler.executors.default] Running job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:09:10 UTC)" (scheduled at 2020-07-23 07:08:40.004697+00:00) gcworker stdout | 2020-07-23 07:08:40,008 [110] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1594278520006, 1209600, 500, 1, 0]) gcworker stdout | 2020-07-23 07:08:40,018 [110] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2020-07-23 07:08:40,018 [110] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:08:40,019 [110] [INFO] [apscheduler.executors.default] Job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:09:10 UTC)" executed successfully builder stdout | 2020-07-23 07:08:40,628 [130] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'builder.py', 'pid': '130'} builder stdout | 2020-07-23 07:08:40,744 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:08:40,759 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:08:40,759 [130] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:08:40,909 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositorygcworker.py', 'pid': '102'} namespacegcworker stdout | 2020-07-23 07:08:40,927 [134] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'namespacegcworker.py', 'pid': '134'} blobuploadcleanupworker stdout | 2020-07-23 07:08:41,414 [119] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'blobuploadcleanupworker.py', 'pid': '119'} security_notification_worker stdout | 2020-07-23 07:08:42,894 [101] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'security_notification_worker.py', 'pid': '101'} logrotateworker stdout | 2020-07-23 07:08:42,968 [118] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'logrotateworker.py', 'pid': '118'} storagereplication stdout | 2020-07-23 07:08:42,986 [133] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'storagereplication.py', 'pid': '133'} repositoryactioncounter stdout | 2020-07-23 07:08:44,295 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositoryactioncounter.py', 'pid': '114'} servicekey stdout | 2020-07-23 07:08:44,933 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'servicekeyworker.py', 'pid': '98'} gunicorn-web stdout | 2020-07-23 07:08:45,715 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '104'} gunicorn-web stdout | 2020-07-23 07:08:45,727 [435] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '435'} gunicorn-web stdout | 2020-07-23 07:08:45,739 [419] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '419'} gunicorn-web stdout | 2020-07-23 07:08:45,747 [438] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '438'} gunicorn-web stdout | 2020-07-23 07:08:45,755 [433] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '433'} gunicorn-web stdout | 2020-07-23 07:08:45,758 [431] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '431'} gunicorn-web stdout | 2020-07-23 07:08:45,770 [436] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '436'} gunicorn-web stdout | 2020-07-23 07:08:45,774 [420] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '420'} gunicorn-web stdout | 2020-07-23 07:08:45,778 [423] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '423'} repositoryactioncounter stdout | 2020-07-23 07:08:48,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:08:48,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:08:48 UTC)" (scheduled at 2020-07-23 07:08:48.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:08:48,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:08:58.291018+00:00 (in 9.999056 seconds) repositoryactioncounter stdout | 2020-07-23 07:08:48,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:08:48,305 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:08:48,305 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:08:48,305 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:08:58 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:08:48,383 [419] [DEBUG] [app] Starting request: urn:request:4893c17e-08c6-4bbe-82bd-cc5d9ab160c3 (/health/instance) gunicorn-web stdout | 2020-07-23 07:08:48,386 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:08:48,392 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:08:48,398 [474] [DEBUG] [app] Starting request: urn:request:0ef12b19-9645-40ef-894c-f2a8a1c8d737 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:08:48,401 [474] [DEBUG] [app] Ending request: urn:request:0ef12b19-9645-40ef-894c-f2a8a1c8d737 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.010 162 0.010) gunicorn-web stdout | 2020-07-23 07:08:48,404 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:08:48,405 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2020-07-23 07:08:48,403 [474] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:08:48,413 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:08:48,421 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:08:48,427 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:08:48,429 [419] [DEBUG] [app] Starting request: urn:request:409c754b-9e98-4433-817e-c0e75c576e31 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:08:48,430 [419] [DEBUG] [app] Ending request: urn:request:409c754b-9e98-4433-817e-c0e75c576e31 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:48 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:08:48,431 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:48 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:08:48,431 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:08:48,435 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:08:48,436 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:48 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:08:48,439 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:08:48,440 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:48 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:08:48,445 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:08:48,446 [466] [DEBUG] [app] Starting request: urn:request:0716f994-0ddd-441c-bce3-d8f81761f8d5 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:48 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:08:48,447 [466] [DEBUG] [app] Ending request: urn:request:0716f994-0ddd-441c-bce3-d8f81761f8d5 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:08:48,448 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:08:48,448 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:48 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:08:48,451 [419] [DEBUG] [app] Ending request: urn:request:4893c17e-08c6-4bbe-82bd-cc5d9ab160c3 (/health/instance) gunicorn-web stdout | 2020-07-23 07:08:48,451 [419] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:08:48 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.071 49 0.071) gunicorn-web stdout | 2020-07-23 07:08:48,452 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:08:48 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" gunicorn-web stdout | 2020-07-23 07:08:49,390 [423] [DEBUG] [app] Starting request: urn:request:3310c2ba-8f26-47b3-b0b2-f352c51ddeb0 (/health/instance) gunicorn-web stdout | 2020-07-23 07:08:49,397 [423] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): localhost:8443 gunicorn-web stdout | 2020-07-23 07:08:49,406 [423] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:08:49,409 [481] [DEBUG] [app] Starting request: urn:request:54636ce3-b7cb-4b34-9b93-2058d2887014 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:08:49,410 [481] [DEBUG] [app] Ending request: urn:request:54636ce3-b7cb-4b34-9b93-2058d2887014 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:08:49,411 [481] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:49 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:49 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:08:49,411 [423] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:08:49,415 [423] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:08:49,423 [423] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:08:49,433 [423] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:08:49,438 [423] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:08:49,441 [419] [DEBUG] [app] Starting request: urn:request:4b70f045-b642-406f-8c85-5b4c0aad2aee (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:08:49,442 [419] [DEBUG] [app] Ending request: urn:request:4b70f045-b642-406f-8c85-5b4c0aad2aee (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:49 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:08:49,443 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:49 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:08:49,443 [423] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:08:49,447 [423] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:49 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:08:49,448 [423] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:08:49,452 [423] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:08:49,453 [423] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:49 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:08:49,457 [423] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2020, 7, 23, 7, 8, 49, 455666), None, u'quay', u'quay', datetime.datetime(2020, 7, 23, 7, 8, 49, 455741), u'quay', None, datetime.datetime(2020, 7, 22, 7, 8, 49, 455779), datetime.datetime(2020, 7, 16, 7, 8, 49, 455816), None]) gunicorn-web stdout | 2020-07-23 07:08:49,472 [423] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:08:49,474 [466] [DEBUG] [app] Starting request: urn:request:b71fb7d7-213d-4615-9b44-3f33d725094c (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:08:49,475 [466] [DEBUG] [app] Ending request: urn:request:b71fb7d7-213d-4615-9b44-3f33d725094c (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:49 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-verbs stdout | 2020-07-23 07:08:49,476 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:49 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:08:49,476 [423] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:08:49,480 [423] [DEBUG] [app] Ending request: urn:request:3310c2ba-8f26-47b3-b0b2-f352c51ddeb0 (/health/instance) gunicorn-web stdout | 2020-07-23 07:08:49,481 [423] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:08:49,482 [423] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:08:49 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:08:49 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.098 49 0.098) notificationworker stdout | 2020-07-23 07:08:49,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:08:49,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:08:59.911177+00:00 (in 9.999018 seconds) notificationworker stdout | 2020-07-23 07:08:49,913 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:08:59 UTC)" (scheduled at 2020-07-23 07:08:49.911177+00:00) 2020-07-23 07:08:49,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:08:49,917 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 8, 49, 913839), True, datetime.datetime(2020, 7, 23, 7, 8, 49, 913839), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:08:49,927 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:08:49,927 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:08:49,927 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:08:59 UTC)" executed successfully builder stdout | 2020-07-23 07:08:50,579 [130] [DEBUG] [buildman.server] Writing metrics builder stdout | 2020-07-23 07:08:50,593 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds builder stdout | 2020-07-23 07:08:50,760 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:08:50,767 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:08:50,767 [130] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2020-07-23 07:08:52,421 [469] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '469'} gunicorn-registry stdout | 2020-07-23 07:08:52,438 [100] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '100'} gunicorn-registry stdout | 2020-07-23 07:08:52,443 [463] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '463'} security_notification_worker stdout | 2020-07-23 07:08:52,447 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:08:52,448 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:00.351857+00:00 (in 7.904117 seconds) security_notification_worker stdout | 2020-07-23 07:08:52,448 [101] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:09:52 UTC)" (scheduled at 2020-07-23 07:08:52.446816+00:00) 2020-07-23 07:08:52,454 [101] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:08:52,454 [101] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:09:52 UTC)" executed successfully gunicorn-registry stdout | 2020-07-23 07:08:52,457 [477] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '477'} gunicorn-registry stdout | 2020-07-23 07:08:52,459 [478] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '478'} gunicorn-registry stdout | 2020-07-23 07:08:52,469 [470] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '470'} gunicorn-registry stdout | 2020-07-23 07:08:52,479 [480] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '480'} gunicorn-registry stdout | 2020-07-23 07:08:52,486 [476] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '476'} gunicorn-registry stdout | 2020-07-23 07:08:52,489 [475] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '475'} gunicorn-registry stdout | 2020-07-23 07:08:52,501 [467] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '467'} gunicorn-registry stdout | 2020-07-23 07:08:52,510 [479] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '479'} gunicorn-registry stdout | 2020-07-23 07:08:52,520 [474] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '474'} gunicorn-registry stdout | 2020-07-23 07:08:52,526 [472] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '472'} gunicorn-registry stdout | 2020-07-23 07:08:52,535 [473] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '473'} gunicorn-registry stdout | 2020-07-23 07:08:52,540 [465] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '465'} gunicorn-registry stdout | 2020-07-23 07:08:52,545 [471] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '471'} gunicorn-registry stdout | 2020-07-23 07:08:52,548 [481] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '481'} gunicorn-verbs stdout | 2020-07-23 07:08:52,950 [127] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'verbs:application', 'pid': '127'} buildlogsarchiver stdout | 2020-07-23 07:08:56,396 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:08:56,396 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:26.395393+00:00 (in 29.999087 seconds) 2020-07-23 07:08:56,397 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:09:26 UTC)" (scheduled at 2020-07-23 07:08:56.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:08:56,399 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 8, 56, 397496), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:08:56,407 [109] [DEBUG] [__main__] No more builds to archive 2020-07-23 07:08:56,407 [109] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2020-07-23 07:08:56,407 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:09:26 UTC)" executed successfully repositoryactioncounter stdout | 2020-07-23 07:08:58,294 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:08:58,294 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:08.291018+00:00 (in 9.996725 seconds) 2020-07-23 07:08:58,294 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:09:08 UTC)" (scheduled at 2020-07-23 07:08:58.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:08:58,297 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:08:58,305 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:08:58,306 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:08:58,306 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:09:08 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:08:58,382 [438] [DEBUG] [app] Starting request: urn:request:60b42999-73bb-4a61-9f7b-d6172af64a14 (/health/instance) gunicorn-web stdout | 2020-07-23 07:08:58,385 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:08:58,391 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:08:58,393 [478] [DEBUG] [app] Starting request: urn:request:9b18c85a-ff98-43c2-8a34-a154a1c101dc (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:08:58,394 [478] [DEBUG] [app] Ending request: urn:request:9b18c85a-ff98-43c2-8a34-a154a1c101dc (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:08:58,395 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:08:58,396 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2020-07-23 07:08:58,398 [478] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:08:58,403 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:08:58,410 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:08:58,415 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:08:58,417 [438] [DEBUG] [app] Starting request: urn:request:28249916-64c7-41f4-9909-d2a738039ff4 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:08:58,418 [438] [DEBUG] [app] Ending request: urn:request:28249916-64c7-41f4-9909-d2a738039ff4 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:08:58,419 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:58 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:58 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 159 0.002) gunicorn-web stdout | 2020-07-23 07:08:58,419 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:08:58,423 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:58 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:08:58,424 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:08:58,427 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:08:58,428 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:58 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:08:58,432 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:08:58,433 [462] [DEBUG] [app] Starting request: urn:request:9abcff92-c699-4a9a-813c-9b88b6fcf1aa (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:08:58,434 [462] [DEBUG] [app] Ending request: urn:request:9abcff92-c699-4a9a-813c-9b88b6fcf1aa (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:08:58,435 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:58 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:08:58,435 [462] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:58 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:08:58,438 [438] [DEBUG] [app] Ending request: urn:request:60b42999-73bb-4a61-9f7b-d6172af64a14 (/health/instance) 2020-07-23 07:08:58,438 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:08:58,439 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:08:58 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:08:58 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.060 49 0.060) gunicorn-web stdout | 2020-07-23 07:08:59,384 [438] [DEBUG] [app] Starting request: urn:request:21ec1bea-c3fc-48f8-a7c8-c0314cde0535 (/health/instance) gunicorn-web stdout | 2020-07-23 07:08:59,388 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:08:59,390 [475] [DEBUG] [app] Starting request: urn:request:d0537026-d79f-41fc-884a-991bc7af1b48 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:08:59,391 [475] [DEBUG] [app] Ending request: urn:request:d0537026-d79f-41fc-884a-991bc7af1b48 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:59 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-registry stdout | 2020-07-23 07:08:59,392 [475] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:59 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:08:59,392 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:08:59,393 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:08:59,400 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:08:59,408 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:08:59,413 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:08:59,415 [436] [DEBUG] [app] Starting request: urn:request:ccc26b45-2a43-43a7-ba05-097af9983df8 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:08:59,417 [436] [DEBUG] [app] Ending request: urn:request:ccc26b45-2a43-43a7-ba05-097af9983df8 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:08:59,417 [436] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:59 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:08:59,418 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:59 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:08:59,422 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:59 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:08:59,423 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:08:59,427 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:08:59,428 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:59 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:08:59,432 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:08:59,434 [466] [DEBUG] [app] Starting request: urn:request:59d3567a-9255-41a7-b16f-5b33af2ac57f (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:08:59 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 162 0.002) gunicorn-verbs stdout | 2020-07-23 07:08:59,435 [466] [DEBUG] [app] Ending request: urn:request:59d3567a-9255-41a7-b16f-5b33af2ac57f (/c1/_internal_ping) 2020-07-23 07:08:59,436 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:08:59 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:08:59,436 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:08:59,438 [438] [DEBUG] [app] Ending request: urn:request:21ec1bea-c3fc-48f8-a7c8-c0314cde0535 (/health/instance) gunicorn-web stdout | 2020-07-23 07:08:59,439 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:08:59,440 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:08:59 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:08:59 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.057 49 0.057) notificationworker stdout | 2020-07-23 07:08:59,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:08:59,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:09.911177+00:00 (in 9.999009 seconds) 2020-07-23 07:08:59,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:09:09 UTC)" (scheduled at 2020-07-23 07:08:59.911177+00:00) 2020-07-23 07:08:59,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:08:59,914 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 8, 59, 913260), True, datetime.datetime(2020, 7, 23, 7, 8, 59, 913260), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:08:59,924 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:08:59,924 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:08:59,925 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:09:09 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:09:00,358 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:09:00,359 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:30.351857+00:00 (in 29.993152 seconds) 2020-07-23 07:09:00,359 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:09:30 UTC)" (scheduled at 2020-07-23 07:09:00.351857+00:00) 2020-07-23 07:09:00,359 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:09:00,361 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 9, 0, 359678), True, datetime.datetime(2020, 7, 23, 7, 9, 0, 359678), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:09:00,369 [101] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:09:00,369 [101] [DEBUG] [data.database] Disconnecting from database. security_notification_worker stdout | 2020-07-23 07:09:00,370 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:09:30 UTC)" executed successfully builder stdout | 2020-07-23 07:09:00,777 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:09:00,789 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:09:00,789 [130] [DEBUG] [data.database] Disconnecting from database. securityworker stdout | 2020-07-23 07:09:03,479 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run securityworker stdout | 2020-07-23 07:09:03,479 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:33.476607+00:00 (in 29.997177 seconds) 2020-07-23 07:09:03,480 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:09:33 UTC)" (scheduled at 2020-07-23 07:09:03.476607+00:00) 2020-07-23 07:09:03,480 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:09:33 UTC)" executed successfully exportactionlogsworker stdout | 2020-07-23 07:09:03,972 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:09:03,972 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:08.212267+00:00 (in 4.239650 seconds) 2020-07-23 07:09:03,973 [99] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:10:03 UTC)" (scheduled at 2020-07-23 07:09:03.971686+00:00) 2020-07-23 07:09:03,973 [99] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2020-07-23 07:09:03,976 [99] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 9, 3, 973414), True, datetime.datetime(2020, 7, 23, 7, 9, 3, 973414), 0, u'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2020-07-23 07:09:03,985 [99] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:09:03,985 [99] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2020-07-23 07:09:03,985 [99] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:10:03 UTC)" executed successfully gcworker stdout | 2020-07-23 07:09:04,636 [110] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'gcworker.py', 'pid': '110'} expiredappspecifictokenworker stdout | 2020-07-23 07:09:05,006 [126] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '126'} securityworker stdout | 2020-07-23 07:09:05,647 [128] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'securityworker.py', 'pid': '128'} teamsyncworker stdout | 2020-07-23 07:09:05,967 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'teamsyncworker.py', 'pid': '115'} namespacegcworker stdout | 2020-07-23 07:09:06,911 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:09:06,911 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:39.024941+00:00 (in 32.113668 seconds) 2020-07-23 07:09:06,912 [134] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:10:06 UTC)" (scheduled at 2020-07-23 07:09:06.910005+00:00) 2020-07-23 07:09:06,912 [134] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2020-07-23 07:09:06,914 [134] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 9, 6, 912661), True, datetime.datetime(2020, 7, 23, 7, 9, 6, 912661), 0, u'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2020-07-23 07:09:06,926 [134] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:09:06,926 [134] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:09:06,927 [134] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:10:06 UTC)" executed successfully exportactionlogsworker stdout | 2020-07-23 07:09:07,404 [99] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'exportactionlogsworker.py', 'pid': '99'} queuecleanupworker stdout | 2020-07-23 07:09:07,788 [103] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'queuecleanupworker.py', 'pid': '103'} gunicorn-secscan stdout | 2020-07-23 07:09:07,859 [413] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '413'} gunicorn-secscan stdout | 2020-07-23 07:09:07,869 [412] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '412'} gunicorn-secscan stdout | 2020-07-23 07:09:07,878 [122] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '122'} gunicorn-secscan stdout | 2020-07-23 07:09:07,885 [411] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '411'} gunicorn-secscan stdout | 2020-07-23 07:09:07,888 [414] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '414'} exportactionlogsworker stdout | 2020-07-23 07:09:08,212 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:09:08,213 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:03.971686+00:00 (in 55.758509 seconds) 2020-07-23 07:09:08,213 [99] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:10:08 UTC)" (scheduled at 2020-07-23 07:09:08.212267+00:00) 2020-07-23 07:09:08,214 [99] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:09:08,214 [99] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:10:08 UTC)" executed successfully repositoryactioncounter stdout | 2020-07-23 07:09:08,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:09:08,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:18.291018+00:00 (in 9.999035 seconds) 2020-07-23 07:09:08,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:09:18 UTC)" (scheduled at 2020-07-23 07:09:08.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:09:08,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:09:08,304 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:09:08,304 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:09:08,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:09:18 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:09:08,383 [419] [DEBUG] [app] Starting request: urn:request:4612392d-bfa6-4397-bf27-fecc2bf2963d (/health/instance) gunicorn-web stdout | 2020-07-23 07:09:08,387 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:09:08,392 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:09:08,394 [463] [DEBUG] [app] Starting request: urn:request:73ba98ad-7865-4e66-a3a0-80ac44c8b69e (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:09:08,396 [463] [DEBUG] [app] Ending request: urn:request:73ba98ad-7865-4e66-a3a0-80ac44c8b69e (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:08 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-registry stdout | 2020-07-23 07:09:08,397 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:08 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:09:08,397 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:09:08,399 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:09:08,406 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:09:08,417 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:09:08,424 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:09:08,427 [436] [DEBUG] [app] Starting request: urn:request:a52cf2e9-44d1-41f3-a4f4-7c7cc742423c (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:09:08,428 [436] [DEBUG] [app] Ending request: urn:request:a52cf2e9-44d1-41f3-a4f4-7c7cc742423c (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:09:08,429 [436] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:08 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:08 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:09:08,430 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:09:08,434 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) 2020-07-23 07:09:08,435 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:08 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:09:08,439 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:08 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:09:08,441 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:09:08,448 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:09:08,449 [462] [DEBUG] [app] Starting request: urn:request:51ce2318-02c8-43f0-b90f-7e1755c51d02 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:08 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:09:08,450 [462] [DEBUG] [app] Ending request: urn:request:51ce2318-02c8-43f0-b90f-7e1755c51d02 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:09:08,451 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:09:08,451 [462] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:08 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:09:08,453 [419] [DEBUG] [app] Ending request: urn:request:4612392d-bfa6-4397-bf27-fecc2bf2963d (/health/instance) 2020-07-23 07:09:08,454 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:09:08,455 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:09:08 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:09:08 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.074 49 0.074) globalpromstats stdout | 2020-07-23 07:09:08,664 [129] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'globalpromstats.py', 'pid': '129'} buildlogsarchiver stdout | 2020-07-23 07:09:09,019 [109] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'buildlogsarchiver.py', 'pid': '109'} notificationworker stdout | 2020-07-23 07:09:09,267 [113] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'notificationworker.py', 'pid': '113'} gunicorn-web stdout | 2020-07-23 07:09:09,384 [438] [DEBUG] [app] Starting request: urn:request:e51be8de-dac1-4f2d-914d-f8fb342e6251 (/health/instance) gunicorn-web stdout | 2020-07-23 07:09:09,387 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:09:09,392 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:09:09,394 [463] [DEBUG] [app] Starting request: urn:request:218fc50f-3a63-4281-b58b-ac5e99704bc1 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:09:09,395 [463] [DEBUG] [app] Ending request: urn:request:218fc50f-3a63-4281-b58b-ac5e99704bc1 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-registry stdout | 2020-07-23 07:09:09,396 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:09:09,396 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:09:09,397 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:09:09,403 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:09:09,411 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:09:09,417 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:09:09,420 [419] [DEBUG] [app] Starting request: urn:request:6cb00701-845f-4114-a2fa-295f71aee80d (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:09:09,421 [419] [DEBUG] [app] Ending request: urn:request:6cb00701-845f-4114-a2fa-295f71aee80d (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:09:09,422 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:09:09,422 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:09:09,427 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:09 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:09:09,428 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:09:09,434 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:09 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:09:09,435 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:09:09,440 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:09:09,445 [464] [DEBUG] [app] Starting request: urn:request:b8de55a4-f867-43d0-abcc-2417668697f9 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:09:09,450 [464] [DEBUG] [app] Ending request: urn:request:b8de55a4-f867-43d0-abcc-2417668697f9 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:09 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.010 162 0.010) gunicorn-web stdout | 2020-07-23 07:09:09,451 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:09:09,451 [464] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:09 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:09:09,453 [438] [DEBUG] [app] Ending request: urn:request:e51be8de-dac1-4f2d-914d-f8fb342e6251 (/health/instance) 2020-07-23 07:09:09,453 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:09:09,454 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:09:09 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:09:09 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.071 49 0.071) chunkcleanupworker stdout | 2020-07-23 07:09:09,458 [124] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'chunkcleanupworker.py', 'pid': '124'} notificationworker stdout | 2020-07-23 07:09:09,912 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:09:09,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:09:19 UTC)" (scheduled at 2020-07-23 07:09:09.911177+00:00) 2020-07-23 07:09:09,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:11.998621+00:00 (in 2.086396 seconds) 2020-07-23 07:09:09,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:09:09,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 9, 9, 913424), True, datetime.datetime(2020, 7, 23, 7, 9, 9, 913424), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:09:09,924 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:09:09,924 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:09:09,925 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:09:19 UTC)" executed successfully gcworker stdout | 2020-07-23 07:09:10,005 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2020-07-23 07:09:10,005 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:40.004697+00:00 (in 29.999159 seconds) 2020-07-23 07:09:10,006 [110] [INFO] [apscheduler.executors.default] Running job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:09:40 UTC)" (scheduled at 2020-07-23 07:09:10.004697+00:00) gcworker stdout | 2020-07-23 07:09:10,008 [110] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1594278550006, 1209600, 500, 1, 0]) gcworker stdout | 2020-07-23 07:09:10,018 [110] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2020-07-23 07:09:10,019 [110] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:09:10,019 [110] [INFO] [apscheduler.executors.default] Job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:09:40 UTC)" executed successfully builder stdout | 2020-07-23 07:09:10,658 [130] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'builder.py', 'pid': '130'} builder stdout | 2020-07-23 07:09:10,799 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:09:10,813 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:09:10,814 [130] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:09:10,951 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositorygcworker.py', 'pid': '102'} namespacegcworker stdout | 2020-07-23 07:09:10,965 [134] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'namespacegcworker.py', 'pid': '134'} blobuploadcleanupworker stdout | 2020-07-23 07:09:11,453 [119] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'blobuploadcleanupworker.py', 'pid': '119'} notificationworker stdout | 2020-07-23 07:09:12,002 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:09:12,002 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:19.911177+00:00 (in 7.908941 seconds) 2020-07-23 07:09:12,002 [113] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:10:11 UTC)" (scheduled at 2020-07-23 07:09:11.998621+00:00) 2020-07-23 07:09:12,003 [113] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:09:12,003 [113] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:10:11 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:09:12,927 [101] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'security_notification_worker.py', 'pid': '101'} logrotateworker stdout | 2020-07-23 07:09:13,005 [118] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'logrotateworker.py', 'pid': '118'} storagereplication stdout | 2020-07-23 07:09:13,025 [133] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'storagereplication.py', 'pid': '133'} repositoryactioncounter stdout | 2020-07-23 07:09:14,334 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositoryactioncounter.py', 'pid': '114'} servicekey stdout | 2020-07-23 07:09:14,975 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'servicekeyworker.py', 'pid': '98'} gunicorn-web stdout | 2020-07-23 07:09:15,725 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '104'} gunicorn-web stdout | 2020-07-23 07:09:15,741 [435] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '435'} gunicorn-web stdout | 2020-07-23 07:09:15,751 [419] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '419'} gunicorn-web stdout | 2020-07-23 07:09:15,762 [438] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '438'} gunicorn-web stdout | 2020-07-23 07:09:15,770 [433] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '433'} gunicorn-web stdout | 2020-07-23 07:09:15,778 [431] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '431'} gunicorn-web stdout | 2020-07-23 07:09:15,784 [436] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '436'} gunicorn-web stdout | 2020-07-23 07:09:15,788 [420] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '420'} gunicorn-web stdout | 2020-07-23 07:09:15,792 [423] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '423'} repositoryactioncounter stdout | 2020-07-23 07:09:18,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:09:18,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:28.291018+00:00 (in 9.999091 seconds) 2020-07-23 07:09:18,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:09:28 UTC)" (scheduled at 2020-07-23 07:09:18.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:09:18,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:09:18,303 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:09:18,303 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:09:18,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:09:28 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:09:18,383 [419] [DEBUG] [app] Starting request: urn:request:b6a4cb90-b3b7-425a-9691-dfcd9c0e5aed (/health/instance) 2020-07-23 07:09:18,386 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:09:18,391 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:09:18,393 [481] [DEBUG] [app] Starting request: urn:request:6ac26265-36e9-411f-8c38-20fcf5c5fc5d (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:09:18,395 [481] [DEBUG] [app] Ending request: urn:request:6ac26265-36e9-411f-8c38-20fcf5c5fc5d (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:09:18,396 [481] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:18 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:18 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:09:18,398 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:09:18,399 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:09:18,404 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:09:18,412 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:09:18,418 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:09:18,420 [419] [DEBUG] [app] Starting request: urn:request:d6758c95-6d05-4bc9-9678-d184481169fb (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:09:18,421 [419] [DEBUG] [app] Ending request: urn:request:d6758c95-6d05-4bc9-9678-d184481169fb (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:09:18,421 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:18 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:18 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:09:18,422 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:09:18,426 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:18 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:09:18,427 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:09:18,431 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:09:18,432 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:18 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:09:18,436 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:09:18,438 [462] [DEBUG] [app] Starting request: urn:request:21d05f68-6de5-48ee-87b8-b8f7f86b26f7 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:09:18,439 [462] [DEBUG] [app] Ending request: urn:request:21d05f68-6de5-48ee-87b8-b8f7f86b26f7 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:18 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:09:18,440 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:09:18,440 [462] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:18 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:09:18,442 [419] [DEBUG] [app] Ending request: urn:request:b6a4cb90-b3b7-425a-9691-dfcd9c0e5aed (/health/instance) 2020-07-23 07:09:18,442 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:09:18,443 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:09:18 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:09:18 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.062 49 0.062) gunicorn-web stdout | 2020-07-23 07:09:19,384 [419] [DEBUG] [app] Starting request: urn:request:cdc4beb0-6cbd-4ce7-ad89-db5c4557bf60 (/health/instance) gunicorn-web stdout | 2020-07-23 07:09:19,388 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:09:19,390 [478] [DEBUG] [app] Starting request: urn:request:167ec8f9-a178-4458-ad58-4fb0609676eb (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:09:19,391 [478] [DEBUG] [app] Ending request: urn:request:167ec8f9-a178-4458-ad58-4fb0609676eb (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:09:19,392 [478] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:19 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:19 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:09:19,392 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:09:19,393 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:09:19,398 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:09:19,406 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:09:19,411 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:09:19,413 [419] [DEBUG] [app] Starting request: urn:request:bd08c785-e816-4868-a414-ec81d9b0bacd (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:09:19,414 [419] [DEBUG] [app] Ending request: urn:request:bd08c785-e816-4868-a414-ec81d9b0bacd (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:09:19,414 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:19 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:19 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:09:19,415 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:09:19,420 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:19 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:09:19,420 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:09:19,423 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:09:19,425 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:19 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:09:19,429 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:09:19,431 [464] [DEBUG] [app] Starting request: urn:request:ffec8fbc-1f50-4fe3-be26-5919698fdc90 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:09:19,432 [464] [DEBUG] [app] Ending request: urn:request:ffec8fbc-1f50-4fe3-be26-5919698fdc90 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:19 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-verbs stdout | 2020-07-23 07:09:19,433 [464] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:19 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:09:19,433 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:09:19,436 [419] [DEBUG] [app] Ending request: urn:request:cdc4beb0-6cbd-4ce7-ad89-db5c4557bf60 (/health/instance) gunicorn-web stdout | 2020-07-23 07:09:19,436 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:09:19,437 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:09:19 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:09:19 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.054 49 0.054) notificationworker stdout | 2020-07-23 07:09:19,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:09:19,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:29.911177+00:00 (in 9.998996 seconds) 2020-07-23 07:09:19,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:09:29 UTC)" (scheduled at 2020-07-23 07:09:19.911177+00:00) 2020-07-23 07:09:19,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:09:19,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 9, 19, 913126), True, datetime.datetime(2020, 7, 23, 7, 9, 19, 913126), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:09:19,926 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:09:19,926 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:09:19,926 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:09:29 UTC)" executed successfully builder stdout | 2020-07-23 07:09:20,604 [130] [DEBUG] [buildman.server] Writing metrics builder stdout | 2020-07-23 07:09:20,619 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds builder stdout | 2020-07-23 07:09:20,815 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:09:20,821 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:09:20,822 [130] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:09:21,739 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:09:21,740 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:28.907644+00:00 (in 7.167556 seconds) 2020-07-23 07:09:21,740 [102] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:10:21 UTC)" (scheduled at 2020-07-23 07:09:21.739118+00:00) 2020-07-23 07:09:21,741 [102] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2020-07-23 07:09:21,743 [102] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 9, 21, 741124), True, datetime.datetime(2020, 7, 23, 7, 9, 21, 741124), 0, u'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2020-07-23 07:09:21,753 [102] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:09:21,753 [102] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:09:21,753 [102] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:10:21 UTC)" executed successfully gunicorn-registry stdout | 2020-07-23 07:09:22,431 [469] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '469'} gunicorn-registry stdout | 2020-07-23 07:09:22,452 [100] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '100'} gunicorn-registry stdout | 2020-07-23 07:09:22,457 [463] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '463'} gunicorn-registry stdout | 2020-07-23 07:09:22,471 [477] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '477'} gunicorn-registry stdout | 2020-07-23 07:09:22,478 [478] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '478'} gunicorn-registry stdout | 2020-07-23 07:09:22,485 [470] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '470'} gunicorn-registry stdout | 2020-07-23 07:09:22,496 [480] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '480'} gunicorn-registry stdout | 2020-07-23 07:09:22,504 [475] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '475'} gunicorn-registry stdout | 2020-07-23 07:09:22,510 [476] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '476'} gunicorn-registry stdout | 2020-07-23 07:09:22,517 [467] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '467'} gunicorn-registry stdout | 2020-07-23 07:09:22,525 [479] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '479'} gunicorn-registry stdout | 2020-07-23 07:09:22,546 [472] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '472'} gunicorn-registry stdout | 2020-07-23 07:09:22,553 [474] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '474'} gunicorn-registry stdout | 2020-07-23 07:09:22,561 [473] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '473'} gunicorn-registry stdout | 2020-07-23 07:09:22,564 [465] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '465'} gunicorn-registry stdout | 2020-07-23 07:09:22,569 [471] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '471'} gunicorn-registry stdout | 2020-07-23 07:09:22,572 [481] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '481'} gunicorn-verbs stdout | 2020-07-23 07:09:23,059 [127] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'verbs:application', 'pid': '127'} buildlogsarchiver stdout | 2020-07-23 07:09:26,396 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:09:26,396 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:09:26 UTC)" (scheduled at 2020-07-23 07:09:26.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:09:26,397 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:56.395393+00:00 (in 29.999114 seconds) buildlogsarchiver stdout | 2020-07-23 07:09:26,398 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 9, 26, 396995), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:09:26,407 [109] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2020-07-23 07:09:26,407 [109] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:09:26,407 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:09:56 UTC)" executed successfully repositoryactioncounter stdout | 2020-07-23 07:09:28,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:09:28,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:38.291018+00:00 (in 9.998927 seconds) 2020-07-23 07:09:28,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:09:38 UTC)" (scheduled at 2020-07-23 07:09:28.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:09:28,296 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:09:28,305 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:09:28,305 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:09:28,305 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:09:38 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:09:28,382 [438] [DEBUG] [app] Starting request: urn:request:6b8cae52-566c-4f06-a93c-6594318175cd (/health/instance) gunicorn-web stdout | 2020-07-23 07:09:28,385 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:09:28,390 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:09:28,392 [471] [DEBUG] [app] Starting request: urn:request:097f7eab-a8c7-4847-b535-418a18ae073d (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:09:28,393 [471] [DEBUG] [app] Ending request: urn:request:097f7eab-a8c7-4847-b535-418a18ae073d (/v1/_internal_ping) 2020-07-23 07:09:28,394 [471] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:28 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:28 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:09:28,394 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:09:28,396 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:09:28,401 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:09:28,409 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:09:28,415 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:09:28,416 [438] [DEBUG] [app] Starting request: urn:request:b9dd26ee-4646-4b54-a433-7d0fe59b52eb (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:09:28,418 [438] [DEBUG] [app] Ending request: urn:request:b9dd26ee-4646-4b54-a433-7d0fe59b52eb (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:09:28,418 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:28 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:28 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:09:28,419 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:09:28,423 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:28 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:09:28,424 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:09:28,428 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:28 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:09:28,429 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:09:28,434 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:09:28,439 [461] [DEBUG] [app] Starting request: urn:request:a8a07b1d-205b-49c3-b552-4bbef0a1c9e3 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:09:28,444 [461] [DEBUG] [app] Ending request: urn:request:a8a07b1d-205b-49c3-b552-4bbef0a1c9e3 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:28 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.011 162 0.011) gunicorn-web stdout | 2020-07-23 07:09:28,445 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:09:28,445 [461] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:28 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:09:28,447 [438] [DEBUG] [app] Ending request: urn:request:6b8cae52-566c-4f06-a93c-6594318175cd (/health/instance) 2020-07-23 07:09:28,447 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:09:28,448 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:09:28 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:09:28 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.068 49 0.068) repositorygcworker stdout | 2020-07-23 07:09:28,908 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:09:28,908 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:21.739118+00:00 (in 52.830430 seconds) 2020-07-23 07:09:28,909 [102] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:10:28 UTC)" (scheduled at 2020-07-23 07:09:28.907644+00:00) 2020-07-23 07:09:28,909 [102] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:09:28,909 [102] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:10:28 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:09:29,384 [419] [DEBUG] [app] Starting request: urn:request:fe3fe294-7ef2-4ef8-b4f3-8f4ec64b9be4 (/health/instance) gunicorn-web stdout | 2020-07-23 07:09:29,386 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:09:29,391 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:09:29,393 [480] [DEBUG] [app] Starting request: urn:request:6021b261-cf61-4c83-97ea-460c85fa5c81 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:09:29,395 [480] [DEBUG] [app] Ending request: urn:request:6021b261-cf61-4c83-97ea-460c85fa5c81 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:09:29,395 [480] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:29 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:29 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:09:29,396 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:09:29,397 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:09:29,403 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:09:29,412 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:09:29,417 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:09:29,418 [419] [DEBUG] [app] Starting request: urn:request:188206ad-56d6-4e5a-be35-c8d2f1b3c54e (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:09:29,419 [419] [DEBUG] [app] Ending request: urn:request:188206ad-56d6-4e5a-be35-c8d2f1b3c54e (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:29 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:09:29,420 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:29 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:09:29,421 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:09:29,424 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:29 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:09:29,425 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:09:29,428 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:09:29,429 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:29 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:09:29,433 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:09:29,434 [462] [DEBUG] [app] Starting request: urn:request:fce1da38-27bb-4c38-bb0a-267c8d8f82e2 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:29 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 162 0.002) gunicorn-verbs stdout | 2020-07-23 07:09:29,435 [462] [DEBUG] [app] Ending request: urn:request:fce1da38-27bb-4c38-bb0a-267c8d8f82e2 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:09:29,436 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:09:29,436 [462] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:29 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:09:29,438 [419] [DEBUG] [app] Ending request: urn:request:fe3fe294-7ef2-4ef8-b4f3-8f4ec64b9be4 (/health/instance) gunicorn-web stdout | 2020-07-23 07:09:29,438 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:09:29,439 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:09:29 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:09:29 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.057 49 0.057) notificationworker stdout | 2020-07-23 07:09:29,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:09:29,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:39.911177+00:00 (in 9.999019 seconds) 2020-07-23 07:09:29,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:09:39 UTC)" (scheduled at 2020-07-23 07:09:29.911177+00:00) 2020-07-23 07:09:29,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:09:29,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 9, 29, 913094), True, datetime.datetime(2020, 7, 23, 7, 9, 29, 913094), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:09:29,924 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:09:29,925 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:09:29,925 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:09:39 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:09:30,352 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:09:30,353 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:50.446184+00:00 (in 20.093429 seconds) 2020-07-23 07:09:30,353 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:10:00 UTC)" (scheduled at 2020-07-23 07:09:30.351857+00:00) 2020-07-23 07:09:30,353 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:09:30,356 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 9, 30, 353641), True, datetime.datetime(2020, 7, 23, 7, 9, 30, 353641), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:09:30,364 [101] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:09:30,364 [101] [DEBUG] [data.database] Disconnecting from database. security_notification_worker stdout | 2020-07-23 07:09:30,365 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:10:00 UTC)" executed successfully builder stdout | 2020-07-23 07:09:30,831 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:09:30,843 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:09:30,843 [130] [DEBUG] [data.database] Disconnecting from database. securityworker stdout | 2020-07-23 07:09:33,477 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run securityworker stdout | 2020-07-23 07:09:33,478 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:03.476607+00:00 (in 29.998825 seconds) 2020-07-23 07:09:33,478 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:10:03 UTC)" (scheduled at 2020-07-23 07:09:33.476607+00:00) securityworker stdout | 2020-07-23 07:09:33,479 [128] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "image" AS "t1" WHERE ("t1"."security_indexed_engine" < %s)', [3]) securityworker stdout | 2020-07-23 07:09:33,487 [128] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "image" AS "t1"', []) securityworker stdout | 2020-07-23 07:09:33,488 [128] [DEBUG] [data.secscan_model.secscan_v2_model] Found no additional images to scan 2020-07-23 07:09:33,488 [128] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:09:33,489 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:10:03 UTC)" executed successfully gcworker stdout | 2020-07-23 07:09:34,677 [110] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'gcworker.py', 'pid': '110'} expiredappspecifictokenworker stdout | 2020-07-23 07:09:35,045 [126] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '126'} securityworker stdout | 2020-07-23 07:09:35,687 [128] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'securityworker.py', 'pid': '128'} teamsyncworker stdout | 2020-07-23 07:09:36,006 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'teamsyncworker.py', 'pid': '115'} exportactionlogsworker stdout | 2020-07-23 07:09:37,425 [99] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'exportactionlogsworker.py', 'pid': '99'} queuecleanupworker stdout | 2020-07-23 07:09:37,826 [103] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'queuecleanupworker.py', 'pid': '103'} gunicorn-secscan stdout | 2020-07-23 07:09:37,870 [413] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '413'} gunicorn-secscan stdout | 2020-07-23 07:09:37,880 [412] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '412'} gunicorn-secscan stdout | 2020-07-23 07:09:37,895 [122] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '122'} gunicorn-secscan stdout | 2020-07-23 07:09:37,899 [411] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '411'} gunicorn-secscan stdout | 2020-07-23 07:09:37,904 [414] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '414'} repositoryactioncounter stdout | 2020-07-23 07:09:38,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:09:38,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:48.291018+00:00 (in 9.999119 seconds) 2020-07-23 07:09:38,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:09:48 UTC)" (scheduled at 2020-07-23 07:09:38.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:09:38,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:09:38,303 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:09:38,303 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:09:38,303 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:09:48 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:09:38,382 [438] [DEBUG] [app] Starting request: urn:request:a9687dcf-1632-4014-a23b-0b6dbe9c97cf (/health/instance) gunicorn-web stdout | 2020-07-23 07:09:38,385 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:09:38,391 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:09:38,395 [472] [DEBUG] [app] Starting request: urn:request:eab8c1bf-8454-450a-9fd4-47544b9fe748 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:09:38,399 [472] [DEBUG] [app] Ending request: urn:request:eab8c1bf-8454-450a-9fd4-47544b9fe748 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:38 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.009 162 0.009) gunicorn-registry stdout | 2020-07-23 07:09:38,400 [472] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:38 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:09:38,402 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:09:38,403 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:09:38,409 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:09:38,417 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:09:38,423 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:09:38,425 [419] [DEBUG] [app] Starting request: urn:request:94180338-18e2-40b5-ae9b-937406e5e462 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:09:38,426 [419] [DEBUG] [app] Ending request: urn:request:94180338-18e2-40b5-ae9b-937406e5e462 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:38 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:09:38,427 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:38 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:09:38,427 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:09:38,431 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:38 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:09:38,432 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:09:38,435 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:38 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:09:38,437 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:09:38,441 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:09:38,443 [462] [DEBUG] [app] Starting request: urn:request:18aff110-36c2-4511-8163-9a606c8cd6c5 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:09:38,445 [462] [DEBUG] [app] Ending request: urn:request:18aff110-36c2-4511-8163-9a606c8cd6c5 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:38 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:09:38,445 [462] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:38 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:09:38,446 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:09:38,448 [438] [DEBUG] [app] Ending request: urn:request:a9687dcf-1632-4014-a23b-0b6dbe9c97cf (/health/instance) 2020-07-23 07:09:38,448 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:09:38,449 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:09:38 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:09:38 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.069 49 0.069) globalpromstats stdout | 2020-07-23 07:09:38,702 [129] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'globalpromstats.py', 'pid': '129'} namespacegcworker stdout | 2020-07-23 07:09:39,026 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:09:39,026 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:06.910005+00:00 (in 27.883472 seconds) 2020-07-23 07:09:39,027 [134] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:10:39 UTC)" (scheduled at 2020-07-23 07:09:39.024941+00:00) 2020-07-23 07:09:39,027 [134] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:09:39,027 [134] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:10:39 UTC)" executed successfully buildlogsarchiver stdout | 2020-07-23 07:09:39,057 [109] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'buildlogsarchiver.py', 'pid': '109'} notificationworker stdout | 2020-07-23 07:09:39,301 [113] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'notificationworker.py', 'pid': '113'} gunicorn-web stdout | 2020-07-23 07:09:39,384 [438] [DEBUG] [app] Starting request: urn:request:1ade0b1a-5d47-44f3-89be-4828ce8f45aa (/health/instance) gunicorn-web stdout | 2020-07-23 07:09:39,388 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:09:39,390 [474] [DEBUG] [app] Starting request: urn:request:8a6ac23d-4c8e-452a-9609-f45a9e60ac4f (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:09:39,391 [474] [DEBUG] [app] Ending request: urn:request:8a6ac23d-4c8e-452a-9609-f45a9e60ac4f (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:09:39,392 [474] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:09:39,393 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:09:39,393 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:09:39,400 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:09:39,407 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:09:39,413 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:09:39,415 [438] [DEBUG] [app] Starting request: urn:request:fbf24620-6f0e-4ef0-a9e4-fc728231f2e8 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:09:39,416 [438] [DEBUG] [app] Ending request: urn:request:fbf24620-6f0e-4ef0-a9e4-fc728231f2e8 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:09:39,417 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:09:39,417 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:09:39,421 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:39 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:09:39,422 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:09:39,426 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:09:39,427 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:39 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:09:39,431 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:09:39,433 [461] [DEBUG] [app] Starting request: urn:request:2f5cb0a1-0d2b-460c-9626-2ea096887ba6 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:09:39,435 [461] [DEBUG] [app] Ending request: urn:request:2f5cb0a1-0d2b-460c-9626-2ea096887ba6 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:39 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:09:39,435 [461] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:39 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:09:39,436 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:09:39,437 [438] [DEBUG] [app] Ending request: urn:request:1ade0b1a-5d47-44f3-89be-4828ce8f45aa (/health/instance) 2020-07-23 07:09:39,438 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:09:39,438 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:09:39 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:09:39 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.056 49 0.056) chunkcleanupworker stdout | 2020-07-23 07:09:39,496 [124] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'chunkcleanupworker.py', 'pid': '124'} notificationworker stdout | 2020-07-23 07:09:39,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:09:39,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:49.911177+00:00 (in 9.999033 seconds) 2020-07-23 07:09:39,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:09:49 UTC)" (scheduled at 2020-07-23 07:09:39.911177+00:00) 2020-07-23 07:09:39,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:09:39,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 9, 39, 913206), True, datetime.datetime(2020, 7, 23, 7, 9, 39, 913206), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:09:39,923 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:09:39,924 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:09:39,924 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:09:49 UTC)" executed successfully gcworker stdout | 2020-07-23 07:09:40,005 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2020-07-23 07:09:40,006 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:10.004697+00:00 (in 29.998803 seconds) 2020-07-23 07:09:40,006 [110] [INFO] [apscheduler.executors.default] Running job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:10:10 UTC)" (scheduled at 2020-07-23 07:09:40.004697+00:00) gcworker stdout | 2020-07-23 07:09:40,008 [110] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1594278580006, 1209600, 500, 1, 0]) gcworker stdout | 2020-07-23 07:09:40,021 [110] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2020-07-23 07:09:40,021 [110] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:09:40,022 [110] [INFO] [apscheduler.executors.default] Job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:10:10 UTC)" executed successfully builder stdout | 2020-07-23 07:09:40,681 [130] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'builder.py', 'pid': '130'} builder stdout | 2020-07-23 07:09:40,854 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:09:40,867 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:09:40,867 [130] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:09:40,991 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositorygcworker.py', 'pid': '102'} namespacegcworker stdout | 2020-07-23 07:09:41,004 [134] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'namespacegcworker.py', 'pid': '134'} blobuploadcleanupworker stdout | 2020-07-23 07:09:41,476 [119] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'blobuploadcleanupworker.py', 'pid': '119'} security_notification_worker stdout | 2020-07-23 07:09:42,965 [101] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'security_notification_worker.py', 'pid': '101'} logrotateworker stdout | 2020-07-23 07:09:43,044 [118] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'logrotateworker.py', 'pid': '118'} storagereplication stdout | 2020-07-23 07:09:43,064 [133] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'storagereplication.py', 'pid': '133'} repositoryactioncounter stdout | 2020-07-23 07:09:44,373 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositoryactioncounter.py', 'pid': '114'} servicekey stdout | 2020-07-23 07:09:45,012 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'servicekeyworker.py', 'pid': '98'} gunicorn-web stdout | 2020-07-23 07:09:45,739 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '104'} gunicorn-web stdout | 2020-07-23 07:09:45,751 [435] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '435'} gunicorn-web stdout | 2020-07-23 07:09:45,763 [419] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '419'} gunicorn-web stdout | 2020-07-23 07:09:45,773 [438] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '438'} gunicorn-web stdout | 2020-07-23 07:09:45,781 [433] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '433'} gunicorn-web stdout | 2020-07-23 07:09:45,800 [431] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '431'} gunicorn-web stdout | 2020-07-23 07:09:45,805 [436] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '436'} gunicorn-web stdout | 2020-07-23 07:09:45,812 [420] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '420'} gunicorn-web stdout | 2020-07-23 07:09:45,819 [423] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '423'} repositoryactioncounter stdout | 2020-07-23 07:09:48,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:09:48,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:09:58 UTC)" (scheduled at 2020-07-23 07:09:48.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:09:48,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:09:48,295 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:58.291018+00:00 (in 9.998969 seconds) repositoryactioncounter stdout | 2020-07-23 07:09:48,303 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:09:48,303 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:09:48,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:09:58 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:09:48,382 [438] [DEBUG] [app] Starting request: urn:request:f9ac4e9d-8c6e-4c50-b104-e7e62d88c7be (/health/instance) gunicorn-web stdout | 2020-07-23 07:09:48,386 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:09:48,391 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:09:48,393 [467] [DEBUG] [app] Starting request: urn:request:6b8077d9-7c81-4203-aa33-c48194049c37 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:09:48,394 [467] [DEBUG] [app] Ending request: urn:request:6b8077d9-7c81-4203-aa33-c48194049c37 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:09:48,395 [467] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:09:48,395 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:09:48,396 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:09:48,401 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:09:48,408 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:09:48,413 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:09:48,415 [436] [DEBUG] [app] Starting request: urn:request:78d7d371-f0c2-463b-82eb-ab3fae0074c6 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:09:48,416 [436] [DEBUG] [app] Ending request: urn:request:78d7d371-f0c2-463b-82eb-ab3fae0074c6 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:48 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:09:48,416 [436] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:48 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:09:48,417 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:09:48,421 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:48 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:09:48,422 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:09:48,426 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:48 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:09:48,428 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:09:48,432 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:09:48,434 [461] [DEBUG] [app] Starting request: urn:request:95d18870-ccfc-4250-8ba1-5240c3005b8f (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:09:48,435 [461] [DEBUG] [app] Ending request: urn:request:95d18870-ccfc-4250-8ba1-5240c3005b8f (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:09:48,436 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:48 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:09:48,436 [461] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:48 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:09:48,438 [438] [DEBUG] [app] Ending request: urn:request:f9ac4e9d-8c6e-4c50-b104-e7e62d88c7be (/health/instance) 2020-07-23 07:09:48,438 [438] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:09:48 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.058 49 0.058) gunicorn-web stdout | 2020-07-23 07:09:48,439 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:09:48 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" gunicorn-web stdout | 2020-07-23 07:09:49,384 [419] [DEBUG] [app] Starting request: urn:request:d7ccb546-96e2-4f28-b6c9-f5800d1cef93 (/health/instance) gunicorn-web stdout | 2020-07-23 07:09:49,387 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:09:49,392 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:09:49,394 [472] [DEBUG] [app] Starting request: urn:request:ebe050f3-8ca2-49bf-9f70-27ad11c083ee (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:09:49,395 [472] [DEBUG] [app] Ending request: urn:request:ebe050f3-8ca2-49bf-9f70-27ad11c083ee (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:49 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:09:49,396 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:09:49,398 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2020-07-23 07:09:49,399 [472] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:49 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:09:49,404 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:09:49,412 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:09:49,417 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:09:49,419 [436] [DEBUG] [app] Starting request: urn:request:2e5a6509-90a6-4723-9c1e-ea3e6bc71317 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:09:49,420 [436] [DEBUG] [app] Ending request: urn:request:2e5a6509-90a6-4723-9c1e-ea3e6bc71317 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:09:49,421 [436] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:49 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:49 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:09:49,421 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:09:49,425 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:49 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:09:49,426 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:09:49,430 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:09:49,431 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:49 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:09:49,437 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:09:49,439 [461] [DEBUG] [app] Starting request: urn:request:0a4a506b-e14f-4992-8606-5c70449cfea7 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:09:49,440 [461] [DEBUG] [app] Ending request: urn:request:0a4a506b-e14f-4992-8606-5c70449cfea7 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:49 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:09:49,440 [461] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:49 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:09:49,441 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:09:49,443 [419] [DEBUG] [app] Ending request: urn:request:d7ccb546-96e2-4f28-b6c9-f5800d1cef93 (/health/instance) gunicorn-web stdout | 2020-07-23 07:09:49,444 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:09:49,444 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:09:49 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:09:49 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.061 49 0.061) notificationworker stdout | 2020-07-23 07:09:49,912 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:09:49,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:59.911177+00:00 (in 9.998800 seconds) notificationworker stdout | 2020-07-23 07:09:49,915 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:09:59 UTC)" (scheduled at 2020-07-23 07:09:49.911177+00:00) 2020-07-23 07:09:49,915 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:09:49,918 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 9, 49, 915313), True, datetime.datetime(2020, 7, 23, 7, 9, 49, 915313), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:09:49,929 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:09:49,929 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:09:49,929 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:09:59 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:09:50,446 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:09:50,447 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:09:52.446816+00:00 (in 1.999703 seconds) 2020-07-23 07:09:50,447 [101] [INFO] [apscheduler.executors.default] Running job "update_queue_metrics (trigger: interval[0:05:00], next run at: 2020-07-23 07:14:50 UTC)" (scheduled at 2020-07-23 07:09:50.446184+00:00) security_notification_worker stdout | 2020-07-23 07:09:50,449 [101] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2020, 7, 23, 7, 9, 50, 447999), u'security_notification/%']) security_notification_worker stdout | 2020-07-23 07:09:50,457 [101] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2020, 7, 23, 7, 9, 50, 447999), True, datetime.datetime(2020, 7, 23, 7, 9, 50, 447999), 0, u'security_notification/%']) security_notification_worker stdout | 2020-07-23 07:09:50,461 [101] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2020, 7, 23, 7, 9, 50, 447999), True, datetime.datetime(2020, 7, 23, 7, 9, 50, 447999), 0, u'security_notification/%', False, datetime.datetime(2020, 7, 23, 7, 9, 50, 447999), u'security_notification/%']) security_notification_worker stdout | 2020-07-23 07:09:50,463 [101] [DEBUG] [data.database] Disconnecting from database. security_notification_worker stdout | 2020-07-23 07:09:50,464 [101] [INFO] [apscheduler.executors.default] Job "update_queue_metrics (trigger: interval[0:05:00], next run at: 2020-07-23 07:14:50 UTC)" executed successfully builder stdout | 2020-07-23 07:09:50,629 [130] [DEBUG] [buildman.server] Writing metrics builder stdout | 2020-07-23 07:09:50,645 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds builder stdout | 2020-07-23 07:09:50,869 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:09:50,875 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:09:50,875 [130] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2020-07-23 07:09:52,442 [469] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '469'} security_notification_worker stdout | 2020-07-23 07:09:52,447 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:09:52,448 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:00.351857+00:00 (in 7.904065 seconds) 2020-07-23 07:09:52,448 [101] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:10:52 UTC)" (scheduled at 2020-07-23 07:09:52.446816+00:00) 2020-07-23 07:09:52,448 [101] [DEBUG] [workers.queueworker] Running watchdog. security_notification_worker stdout | 2020-07-23 07:09:52,448 [101] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:10:52 UTC)" executed successfully gunicorn-registry stdout | 2020-07-23 07:09:52,465 [100] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '100'} gunicorn-registry stdout | 2020-07-23 07:09:52,470 [463] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '463'} gunicorn-registry stdout | 2020-07-23 07:09:52,484 [477] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '477'} gunicorn-registry stdout | 2020-07-23 07:09:52,493 [478] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '478'} gunicorn-registry stdout | 2020-07-23 07:09:52,498 [470] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '470'} gunicorn-registry stdout | 2020-07-23 07:09:52,508 [480] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '480'} gunicorn-registry stdout | 2020-07-23 07:09:52,533 [475] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '475'} gunicorn-registry stdout | 2020-07-23 07:09:52,534 [476] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '476'} gunicorn-registry stdout | 2020-07-23 07:09:52,539 [467] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '467'} gunicorn-registry stdout | 2020-07-23 07:09:52,544 [479] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '479'} gunicorn-registry stdout | 2020-07-23 07:09:52,560 [472] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '472'} gunicorn-registry stdout | 2020-07-23 07:09:52,570 [474] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '474'} gunicorn-registry stdout | 2020-07-23 07:09:52,577 [473] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '473'} gunicorn-registry stdout | 2020-07-23 07:09:52,584 [465] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '465'} gunicorn-registry stdout | 2020-07-23 07:09:52,591 [471] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '471'} gunicorn-registry stdout | 2020-07-23 07:09:52,596 [481] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '481'} gunicorn-verbs stdout | 2020-07-23 07:09:53,169 [127] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'verbs:application', 'pid': '127'} buildlogsarchiver stdout | 2020-07-23 07:09:56,397 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:09:56,397 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:10:26 UTC)" (scheduled at 2020-07-23 07:09:56.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:09:56,399 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 9, 56, 398006), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:09:56,400 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:26.395393+00:00 (in 29.998001 seconds) buildlogsarchiver stdout | 2020-07-23 07:09:56,408 [109] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2020-07-23 07:09:56,409 [109] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:09:56,409 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:10:26 UTC)" executed successfully repositoryactioncounter stdout | 2020-07-23 07:09:58,294 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:09:58,295 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:08.291018+00:00 (in 9.995849 seconds) repositoryactioncounter stdout | 2020-07-23 07:09:58,297 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:10:08 UTC)" (scheduled at 2020-07-23 07:09:58.291018+00:00) 2020-07-23 07:09:58,299 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:09:58,310 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:09:58,310 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:09:58,310 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:10:08 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:09:58,383 [438] [DEBUG] [app] Starting request: urn:request:cb3882b6-e52a-42d7-b6cf-16c387b1165d (/health/instance) gunicorn-web stdout | 2020-07-23 07:09:58,386 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:09:58,391 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:09:58,393 [480] [DEBUG] [app] Starting request: urn:request:815f2192-f718-40bd-9185-7370dd2f8033 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:09:58,395 [480] [DEBUG] [app] Ending request: urn:request:815f2192-f718-40bd-9185-7370dd2f8033 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:09:58,395 [480] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:09:58,396 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:09:58,397 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:09:58,403 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:09:58,412 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:09:58,417 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:09:58,419 [438] [DEBUG] [app] Starting request: urn:request:e3a93679-57fd-457c-af96-3c0d62128b1e (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:09:58,421 [438] [DEBUG] [app] Ending request: urn:request:e3a93679-57fd-457c-af96-3c0d62128b1e (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:09:58,421 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:58 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:58 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:09:58,422 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:09:58,427 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:58 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:09:58,428 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:09:58,432 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:09:58,433 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:58 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:09:58,437 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:09:58,440 [464] [DEBUG] [app] Starting request: urn:request:c6a3d83c-76a8-4f27-bf00-2433a058bd80 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:09:58,441 [464] [DEBUG] [app] Ending request: urn:request:c6a3d83c-76a8-4f27-bf00-2433a058bd80 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:58 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:09:58,442 [464] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:58 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:09:58,442 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:09:58,444 [438] [DEBUG] [app] Ending request: urn:request:cb3882b6-e52a-42d7-b6cf-16c387b1165d (/health/instance) 2020-07-23 07:09:58,445 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:09:58,446 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:09:58 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:09:58 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.065 49 0.065) gunicorn-web stdout | 2020-07-23 07:09:59,389 [420] [DEBUG] [app] Starting request: urn:request:8b15eab5-46ec-45de-9cbb-72a6af8806a2 (/health/instance) gunicorn-web stdout | 2020-07-23 07:09:59,397 [420] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): localhost:8443 gunicorn-web stdout | 2020-07-23 07:09:59,404 [420] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:09:59,406 [476] [DEBUG] [app] Starting request: urn:request:f403992f-5fd0-4a43-ac51-fe1652dcc58d (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:09:59,408 [476] [DEBUG] [app] Ending request: urn:request:f403992f-5fd0-4a43-ac51-fe1652dcc58d (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:09:59,408 [476] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:59 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:09:59,409 [420] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:59 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:09:59,412 [420] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:09:59,420 [420] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:09:59,428 [420] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:09:59,433 [420] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:09:59,436 [433] [DEBUG] [app] Starting request: urn:request:fa2f028b-6bb7-4757-bb4b-dde5a8cdc440 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:09:59,437 [433] [DEBUG] [app] Ending request: urn:request:fa2f028b-6bb7-4757-bb4b-dde5a8cdc440 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:09:59,437 [433] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:59 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:59 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:09:59,438 [420] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:09:59,442 [420] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:59 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:09:59,444 [420] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:09:59,447 [420] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:59 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:09:59,448 [420] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:09:59,452 [420] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2020, 7, 23, 7, 9, 59, 450225), None, u'quay', u'quay', datetime.datetime(2020, 7, 23, 7, 9, 59, 450268), u'quay', None, datetime.datetime(2020, 7, 22, 7, 9, 59, 450299), datetime.datetime(2020, 7, 16, 7, 9, 59, 450331), None]) gunicorn-web stdout | 2020-07-23 07:09:59,464 [420] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:09:59,466 [461] [DEBUG] [app] Starting request: urn:request:00af25a6-b30f-4d56-9a10-9c7b2d2f8603 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:09:59,467 [461] [DEBUG] [app] Ending request: urn:request:00af25a6-b30f-4d56-9a10-9c7b2d2f8603 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:09:59 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:09:59,467 [461] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:09:59 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:09:59,468 [420] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:09:59,471 [420] [DEBUG] [app] Ending request: urn:request:8b15eab5-46ec-45de-9cbb-72a6af8806a2 (/health/instance) gunicorn-web stdout | 2020-07-23 07:09:59,471 [420] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:09:59 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.089 49 0.089) gunicorn-web stdout | 2020-07-23 07:09:59,472 [420] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:09:59 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" notificationworker stdout | 2020-07-23 07:09:59,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:09:59,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:06.997992+00:00 (in 7.085879 seconds) 2020-07-23 07:09:59,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:10:09 UTC)" (scheduled at 2020-07-23 07:09:59.911177+00:00) 2020-07-23 07:09:59,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:09:59,916 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 9, 59, 913187), True, datetime.datetime(2020, 7, 23, 7, 9, 59, 913187), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:09:59,927 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:09:59,927 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:09:59,928 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:10:09 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:10:00,353 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:10:00,354 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:30.351857+00:00 (in 29.998270 seconds) 2020-07-23 07:10:00,354 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:10:30 UTC)" (scheduled at 2020-07-23 07:10:00.351857+00:00) 2020-07-23 07:10:00,354 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:10:00,356 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 10, 0, 354749), True, datetime.datetime(2020, 7, 23, 7, 10, 0, 354749), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:10:00,366 [101] [DEBUG] [workers.queueworker] No more work. security_notification_worker stdout | 2020-07-23 07:10:00,366 [101] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:10:00,366 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:10:30 UTC)" executed successfully builder stdout | 2020-07-23 07:10:00,886 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:10:00,898 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:10:00,898 [130] [DEBUG] [data.database] Disconnecting from database. securityworker stdout | 2020-07-23 07:10:03,477 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run securityworker stdout | 2020-07-23 07:10:03,478 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:10:33 UTC)" (scheduled at 2020-07-23 07:10:03.476607+00:00) 2020-07-23 07:10:03,478 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:10:33 UTC)" executed successfully 2020-07-23 07:10:03,478 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:33.476607+00:00 (in 29.999066 seconds) exportactionlogsworker stdout | 2020-07-23 07:10:03,972 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:10:03,973 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:08.212267+00:00 (in 4.239466 seconds) 2020-07-23 07:10:03,973 [99] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:11:03 UTC)" (scheduled at 2020-07-23 07:10:03.971686+00:00) 2020-07-23 07:10:03,973 [99] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2020-07-23 07:10:03,976 [99] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 10, 3, 974055), True, datetime.datetime(2020, 7, 23, 7, 10, 3, 974055), 0, u'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2020-07-23 07:10:03,986 [99] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:10:03,986 [99] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2020-07-23 07:10:03,986 [99] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:11:03 UTC)" executed successfully gcworker stdout | 2020-07-23 07:10:04,719 [110] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'gcworker.py', 'pid': '110'} expiredappspecifictokenworker stdout | 2020-07-23 07:10:05,085 [126] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '126'} securityworker stdout | 2020-07-23 07:10:05,727 [128] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'securityworker.py', 'pid': '128'} teamsyncworker stdout | 2020-07-23 07:10:06,052 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'teamsyncworker.py', 'pid': '115'} namespacegcworker stdout | 2020-07-23 07:10:06,910 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:10:06,911 [134] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:11:06 UTC)" (scheduled at 2020-07-23 07:10:06.910005+00:00) 2020-07-23 07:10:06,911 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:39.024941+00:00 (in 32.113909 seconds) 2020-07-23 07:10:06,912 [134] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2020-07-23 07:10:06,914 [134] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 10, 6, 912309), True, datetime.datetime(2020, 7, 23, 7, 10, 6, 912309), 0, u'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2020-07-23 07:10:06,924 [134] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:10:06,924 [134] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:10:06,924 [134] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:11:06 UTC)" executed successfully notificationworker stdout | 2020-07-23 07:10:06,998 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:10:06,999 [113] [INFO] [apscheduler.executors.default] Running job "update_queue_metrics (trigger: interval[0:05:00], next run at: 2020-07-23 07:15:06 UTC)" (scheduled at 2020-07-23 07:10:06.997992+00:00) notificationworker stdout | 2020-07-23 07:10:06,999 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:09.911177+00:00 (in 2.912179 seconds) 2020-07-23 07:10:07,001 [113] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2020, 7, 23, 7, 10, 6, 999961), u'notification/%']) notificationworker stdout | 2020-07-23 07:10:07,010 [113] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2020, 7, 23, 7, 10, 6, 999961), True, datetime.datetime(2020, 7, 23, 7, 10, 6, 999961), 0, u'notification/%']) notificationworker stdout | 2020-07-23 07:10:07,014 [113] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2020, 7, 23, 7, 10, 6, 999961), True, datetime.datetime(2020, 7, 23, 7, 10, 6, 999961), 0, u'notification/%', False, datetime.datetime(2020, 7, 23, 7, 10, 6, 999961), u'notification/%']) notificationworker stdout | 2020-07-23 07:10:07,016 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:10:07,016 [113] [INFO] [apscheduler.executors.default] Job "update_queue_metrics (trigger: interval[0:05:00], next run at: 2020-07-23 07:15:06 UTC)" executed successfully exportactionlogsworker stdout | 2020-07-23 07:10:07,462 [99] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'exportactionlogsworker.py', 'pid': '99'} queuecleanupworker stdout | 2020-07-23 07:10:07,866 [103] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'queuecleanupworker.py', 'pid': '103'} gunicorn-secscan stdout | 2020-07-23 07:10:07,880 [413] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '413'} gunicorn-secscan stdout | 2020-07-23 07:10:07,891 [412] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '412'} gunicorn-secscan stdout | 2020-07-23 07:10:07,906 [122] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '122'} gunicorn-secscan stdout | 2020-07-23 07:10:07,914 [411] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '411'} gunicorn-secscan stdout | 2020-07-23 07:10:07,918 [414] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '414'} exportactionlogsworker stdout | 2020-07-23 07:10:08,217 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:10:08,217 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:57.209762+00:00 (in 48.992466 seconds) 2020-07-23 07:10:08,218 [99] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:11:08 UTC)" (scheduled at 2020-07-23 07:10:08.212267+00:00) 2020-07-23 07:10:08,218 [99] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:10:08,218 [99] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:11:08 UTC)" executed successfully repositoryactioncounter stdout | 2020-07-23 07:10:08,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:10:08,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:18.291018+00:00 (in 9.998857 seconds) 2020-07-23 07:10:08,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:10:18 UTC)" (scheduled at 2020-07-23 07:10:08.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:10:08,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:10:08,303 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:10:08,304 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:10:08,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:10:18 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:10:08,383 [435] [DEBUG] [app] Starting request: urn:request:7aeb8419-1409-4ddf-b413-874e25d3e7ff (/health/instance) gunicorn-web stdout | 2020-07-23 07:10:08,386 [435] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:10:08,392 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:10:08,396 [477] [DEBUG] [app] Starting request: urn:request:8f6a55b6-8367-49e0-94df-d9155f930bb1 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:10:08,399 [477] [DEBUG] [app] Ending request: urn:request:8f6a55b6-8367-49e0-94df-d9155f930bb1 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:08 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.009 162 0.009) gunicorn-registry stdout | 2020-07-23 07:10:08,401 [477] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:08 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:10:08,401 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:10:08,403 [435] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:10:08,409 [435] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:10:08,417 [435] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:10:08,423 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:10:08,425 [435] [DEBUG] [app] Starting request: urn:request:9c5990bb-054c-427d-af2c-b619086abe04 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:10:08,426 [435] [DEBUG] [app] Ending request: urn:request:9c5990bb-054c-427d-af2c-b619086abe04 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:10:08,427 [435] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:08 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:08 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:10:08,428 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:10:08,432 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:08 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:10:08,434 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:10:08,437 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:08 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:10:08,439 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:10:08,444 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:10:08,450 [459] [DEBUG] [app] Starting request: urn:request:9d1f2ae7-9aef-47f8-ab01-56e04bd976b1 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:10:08,456 [459] [DEBUG] [app] Ending request: urn:request:9d1f2ae7-9aef-47f8-ab01-56e04bd976b1 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:08 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.013 162 0.013) gunicorn-web stdout | 2020-07-23 07:10:08,457 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:10:08,457 [459] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:08 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:10:08,460 [435] [DEBUG] [app] Ending request: urn:request:7aeb8419-1409-4ddf-b413-874e25d3e7ff (/health/instance) 2020-07-23 07:10:08,461 [435] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:10:08,462 [435] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:10:08 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:10:08 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.080 49 0.080) globalpromstats stdout | 2020-07-23 07:10:08,735 [129] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'globalpromstats.py', 'pid': '129'} buildlogsarchiver stdout | 2020-07-23 07:10:09,096 [109] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'buildlogsarchiver.py', 'pid': '109'} notificationworker stdout | 2020-07-23 07:10:09,341 [113] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'notificationworker.py', 'pid': '113'} gunicorn-web stdout | 2020-07-23 07:10:09,384 [419] [DEBUG] [app] Starting request: urn:request:2046158b-7304-43bd-b23c-d4da85347d43 (/health/instance) gunicorn-web stdout | 2020-07-23 07:10:09,386 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:10:09,392 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:10:09,394 [463] [DEBUG] [app] Starting request: urn:request:27077a92-dde8-4142-a159-bd779c78bc34 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:10:09,396 [463] [DEBUG] [app] Ending request: urn:request:27077a92-dde8-4142-a159-bd779c78bc34 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-registry stdout | 2020-07-23 07:10:09,396 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:10:09,397 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:10:09,399 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:10:09,404 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:10:09,412 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:10:09,418 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:10:09,420 [419] [DEBUG] [app] Starting request: urn:request:56cd9244-09e3-4a92-a783-52e3971b19f8 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:10:09,421 [419] [DEBUG] [app] Ending request: urn:request:56cd9244-09e3-4a92-a783-52e3971b19f8 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:10:09,422 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:10:09,423 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:10:09,427 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:10:09,428 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:09 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:10:09,431 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:09 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:10:09,434 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:10:09,438 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:10:09,440 [466] [DEBUG] [app] Starting request: urn:request:df1d26d6-f1c7-455b-9d19-2d703844e850 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:10:09,441 [466] [DEBUG] [app] Ending request: urn:request:df1d26d6-f1c7-455b-9d19-2d703844e850 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:09 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-verbs stdout | 2020-07-23 07:10:09,442 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:09 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:10:09,443 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:10:09,445 [419] [DEBUG] [app] Ending request: urn:request:2046158b-7304-43bd-b23c-d4da85347d43 (/health/instance) gunicorn-web stdout | 2020-07-23 07:10:09,445 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:10:09,446 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:10:09 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:10:09 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.064 49 0.064) chunkcleanupworker stdout | 2020-07-23 07:10:09,533 [124] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'chunkcleanupworker.py', 'pid': '124'} notificationworker stdout | 2020-07-23 07:10:09,914 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:10:09,915 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:11.998621+00:00 (in 2.083774 seconds) 2020-07-23 07:10:09,915 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:10:19 UTC)" (scheduled at 2020-07-23 07:10:09.911177+00:00) 2020-07-23 07:10:09,915 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:10:09,917 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 10, 9, 916021), True, datetime.datetime(2020, 7, 23, 7, 10, 9, 916021), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:10:09,926 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:10:09,927 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:10:09,927 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:10:19 UTC)" executed successfully gcworker stdout | 2020-07-23 07:10:10,005 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2020-07-23 07:10:10,005 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:40.004697+00:00 (in 29.999043 seconds) 2020-07-23 07:10:10,006 [110] [INFO] [apscheduler.executors.default] Running job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:10:40 UTC)" (scheduled at 2020-07-23 07:10:10.004697+00:00) gcworker stdout | 2020-07-23 07:10:10,008 [110] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1594278610006, 1209600, 500, 1, 0]) gcworker stdout | 2020-07-23 07:10:10,018 [110] [DEBUG] [__main__] No repository with garbage found 2020-07-23 07:10:10,018 [110] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2020-07-23 07:10:10,018 [110] [INFO] [apscheduler.executors.default] Job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:10:40 UTC)" executed successfully builder stdout | 2020-07-23 07:10:10,817 [130] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'builder.py', 'pid': '130'} builder stdout | 2020-07-23 07:10:10,908 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:10:10,923 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:10:10,923 [130] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:10:11,031 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositorygcworker.py', 'pid': '102'} namespacegcworker stdout | 2020-07-23 07:10:11,047 [134] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'namespacegcworker.py', 'pid': '134'} blobuploadcleanupworker stdout | 2020-07-23 07:10:11,516 [119] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'blobuploadcleanupworker.py', 'pid': '119'} notificationworker stdout | 2020-07-23 07:10:12,000 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:10:12,001 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:19.911177+00:00 (in 7.910270 seconds) 2020-07-23 07:10:12,001 [113] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:11:11 UTC)" (scheduled at 2020-07-23 07:10:11.998621+00:00) 2020-07-23 07:10:12,001 [113] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:10:12,001 [113] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:11:11 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:10:13,005 [101] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'security_notification_worker.py', 'pid': '101'} logrotateworker stdout | 2020-07-23 07:10:13,070 [118] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'logrotateworker.py', 'pid': '118'} storagereplication stdout | 2020-07-23 07:10:13,105 [133] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'storagereplication.py', 'pid': '133'} repositoryactioncounter stdout | 2020-07-23 07:10:14,412 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositoryactioncounter.py', 'pid': '114'} servicekey stdout | 2020-07-23 07:10:15,047 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'servicekeyworker.py', 'pid': '98'} gunicorn-web stdout | 2020-07-23 07:10:15,750 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '104'} gunicorn-web stdout | 2020-07-23 07:10:15,762 [435] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '435'} gunicorn-web stdout | 2020-07-23 07:10:15,773 [419] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '419'} gunicorn-web stdout | 2020-07-23 07:10:15,783 [438] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '438'} gunicorn-web stdout | 2020-07-23 07:10:15,791 [433] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '433'} gunicorn-web stdout | 2020-07-23 07:10:15,813 [431] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '431'} gunicorn-web stdout | 2020-07-23 07:10:15,819 [436] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '436'} gunicorn-web stdout | 2020-07-23 07:10:15,823 [420] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '420'} gunicorn-web stdout | 2020-07-23 07:10:15,832 [423] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '423'} repositoryactioncounter stdout | 2020-07-23 07:10:18,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:10:18,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:28.291018+00:00 (in 9.999013 seconds) 2020-07-23 07:10:18,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:10:28 UTC)" (scheduled at 2020-07-23 07:10:18.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:10:18,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:10:18,304 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:10:18,304 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:10:18,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:10:28 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:10:18,382 [436] [DEBUG] [app] Starting request: urn:request:c05d6fe9-01de-4cc3-ac15-bb751cfcaa64 (/health/instance) gunicorn-web stdout | 2020-07-23 07:10:18,385 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:10:18,390 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:10:18,392 [463] [DEBUG] [app] Starting request: urn:request:c41a85e8-9f43-43f8-9208-af7a209690f3 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:10:18,393 [463] [DEBUG] [app] Ending request: urn:request:c41a85e8-9f43-43f8-9208-af7a209690f3 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:10:18,394 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:18 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:18 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:10:18,395 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:10:18,396 [436] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:10:18,402 [436] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:10:18,410 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:10:18,416 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:10:18,418 [438] [DEBUG] [app] Starting request: urn:request:efa1885c-f013-495b-a5f4-d325df542ef7 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:10:18,419 [438] [DEBUG] [app] Ending request: urn:request:efa1885c-f013-495b-a5f4-d325df542ef7 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:10:18,420 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:18 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:18 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:10:18,420 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:10:18,425 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:18 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:10:18,426 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:10:18,429 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:10:18,431 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:18 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:10:18,435 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:10:18,436 [459] [DEBUG] [app] Starting request: urn:request:d6347efe-8d5d-4c56-9cb3-ae3040135890 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:10:18,438 [459] [DEBUG] [app] Ending request: urn:request:d6347efe-8d5d-4c56-9cb3-ae3040135890 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:18 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:10:18,439 [459] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:18 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:10:18,439 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:10:18,440 [436] [DEBUG] [app] Ending request: urn:request:c05d6fe9-01de-4cc3-ac15-bb751cfcaa64 (/health/instance) gunicorn-web stdout | 2020-07-23 07:10:18,441 [436] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:10:18,442 [436] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:10:18 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:10:18 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.060 49 0.060) gunicorn-web stdout | 2020-07-23 07:10:19,385 [419] [DEBUG] [app] Starting request: urn:request:55d92655-900a-4cf5-8349-9e5d04b4e6b8 (/health/instance) gunicorn-web stdout | 2020-07-23 07:10:19,387 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:10:19,393 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:10:19,395 [472] [DEBUG] [app] Starting request: urn:request:5713b410-37a0-4fb2-aec5-44b526a15ab5 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:10:19,397 [472] [DEBUG] [app] Ending request: urn:request:5713b410-37a0-4fb2-aec5-44b526a15ab5 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:19 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-registry stdout | 2020-07-23 07:10:19,397 [472] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:19 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:10:19,398 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:10:19,399 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:10:19,405 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:10:19,413 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:10:19,419 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:10:19,421 [435] [DEBUG] [app] Starting request: urn:request:56e2e05b-5c42-48e8-8a6a-c1af27579ec5 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:10:19,422 [435] [DEBUG] [app] Ending request: urn:request:56e2e05b-5c42-48e8-8a6a-c1af27579ec5 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:19 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:10:19,423 [435] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:19 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:10:19,423 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:10:19,427 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:19 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:10:19,428 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:10:19,431 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:10:19,433 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:19 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:10:19,438 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:10:19,439 [459] [DEBUG] [app] Starting request: urn:request:a03918e3-f320-42e0-a104-4142a9b8351d (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:10:19,441 [459] [DEBUG] [app] Ending request: urn:request:a03918e3-f320-42e0-a104-4142a9b8351d (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:19 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:10:19,442 [459] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:19 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:10:19,442 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:10:19,444 [419] [DEBUG] [app] Ending request: urn:request:55d92655-900a-4cf5-8349-9e5d04b4e6b8 (/health/instance) gunicorn-web stdout | 2020-07-23 07:10:19,444 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:10:19,444 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:10:19 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:10:19 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.062 49 0.062) notificationworker stdout | 2020-07-23 07:10:19,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:10:19,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:10:19 UTC)" (scheduled at 2020-07-23 07:10:19.911177+00:00) 2020-07-23 07:10:19,912 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:10:19,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 10, 19, 912876), True, datetime.datetime(2020, 7, 23, 7, 10, 19, 912876), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:10:19,916 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:29.911177+00:00 (in 9.999033 seconds) notificationworker stdout | 2020-07-23 07:10:19,925 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:10:19,925 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:10:19,925 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:10:29 UTC)" executed successfully builder stdout | 2020-07-23 07:10:20,656 [130] [DEBUG] [buildman.server] Writing metrics builder stdout | 2020-07-23 07:10:20,670 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds builder stdout | 2020-07-23 07:10:20,925 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:10:20,931 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:10:20,932 [130] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:10:21,739 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:10:21,740 [102] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:11:21 UTC)" (scheduled at 2020-07-23 07:10:21.739118+00:00) 2020-07-23 07:10:21,740 [102] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2020-07-23 07:10:21,743 [102] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 10, 21, 740834), True, datetime.datetime(2020, 7, 23, 7, 10, 21, 740834), 0, u'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2020-07-23 07:10:21,740 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:28.907644+00:00 (in 7.167715 seconds) repositorygcworker stdout | 2020-07-23 07:10:21,752 [102] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2020-07-23 07:10:21,752 [102] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:10:21,752 [102] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:11:21 UTC)" executed successfully gunicorn-registry stdout | 2020-07-23 07:10:22,454 [469] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '469'} gunicorn-registry stdout | 2020-07-23 07:10:22,477 [100] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '100'} gunicorn-registry stdout | 2020-07-23 07:10:22,481 [463] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '463'} gunicorn-registry stdout | 2020-07-23 07:10:22,498 [477] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '477'} gunicorn-registry stdout | 2020-07-23 07:10:22,516 [478] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '478'} gunicorn-registry stdout | 2020-07-23 07:10:22,521 [470] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '470'} gunicorn-registry stdout | 2020-07-23 07:10:22,527 [480] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '480'} gunicorn-registry stdout | 2020-07-23 07:10:22,547 [476] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '476'} gunicorn-registry stdout | 2020-07-23 07:10:22,552 [467] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '467'} gunicorn-registry stdout | 2020-07-23 07:10:22,556 [475] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '475'} gunicorn-registry stdout | 2020-07-23 07:10:22,560 [479] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '479'} gunicorn-registry stdout | 2020-07-23 07:10:22,573 [472] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '472'} gunicorn-registry stdout | 2020-07-23 07:10:22,584 [474] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '474'} gunicorn-registry stdout | 2020-07-23 07:10:22,592 [473] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '473'} gunicorn-registry stdout | 2020-07-23 07:10:22,597 [465] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '465'} gunicorn-registry stdout | 2020-07-23 07:10:22,606 [471] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '471'} gunicorn-registry stdout | 2020-07-23 07:10:22,611 [481] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '481'} gunicorn-verbs stdout | 2020-07-23 07:10:23,277 [127] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'verbs:application', 'pid': '127'} buildlogsarchiver stdout | 2020-07-23 07:10:26,398 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:10:26,399 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:56.395393+00:00 (in 29.996421 seconds) 2020-07-23 07:10:26,399 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:10:56 UTC)" (scheduled at 2020-07-23 07:10:26.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:10:26,401 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 10, 26, 399825), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:10:26,409 [109] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2020-07-23 07:10:26,409 [109] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:10:26,410 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:10:56 UTC)" executed successfully repositoryactioncounter stdout | 2020-07-23 07:10:28,292 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:10:28,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:38.291018+00:00 (in 9.998618 seconds) 2020-07-23 07:10:28,293 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:10:38 UTC)" (scheduled at 2020-07-23 07:10:28.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:10:28,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:10:28,305 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:10:28,305 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:10:28,305 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:10:38 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:10:28,382 [419] [DEBUG] [app] Starting request: urn:request:323e3540-7ebd-4f7f-82d6-1604fb67b99a (/health/instance) gunicorn-web stdout | 2020-07-23 07:10:28,386 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:10:28,391 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:10:28,393 [480] [DEBUG] [app] Starting request: urn:request:9e2f58ea-c61f-458e-a760-9a01a551effc (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:10:28,394 [480] [DEBUG] [app] Ending request: urn:request:9e2f58ea-c61f-458e-a760-9a01a551effc (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:10:28,395 [480] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:28 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:28 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:10:28,395 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:10:28,396 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:10:28,402 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:10:28,409 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:10:28,414 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:10:28,415 [419] [DEBUG] [app] Starting request: urn:request:3f7c9af4-a5c8-42fa-b012-e9f4a76d61de (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:10:28,416 [419] [DEBUG] [app] Ending request: urn:request:3f7c9af4-a5c8-42fa-b012-e9f4a76d61de (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:28 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:10:28,417 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:28 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:10:28,417 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:10:28,421 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:28 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:10:28,422 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:10:28,426 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:28 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:10:28,427 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:10:28,431 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:10:28,432 [466] [DEBUG] [app] Starting request: urn:request:064e654e-af92-4cd8-82d5-10cc845163eb (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:10:28,433 [466] [DEBUG] [app] Ending request: urn:request:064e654e-af92-4cd8-82d5-10cc845163eb (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:10:28,434 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:28 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:10:28,434 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:28 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:10:28,436 [419] [DEBUG] [app] Ending request: urn:request:323e3540-7ebd-4f7f-82d6-1604fb67b99a (/health/instance) 2020-07-23 07:10:28,437 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:10:28,438 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:10:28 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:10:28 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.057 49 0.057) repositorygcworker stdout | 2020-07-23 07:10:28,912 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:10:28,913 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:11:21.739118+00:00 (in 52.826412 seconds) 2020-07-23 07:10:28,913 [102] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:11:28 UTC)" (scheduled at 2020-07-23 07:10:28.907644+00:00) 2020-07-23 07:10:28,913 [102] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:10:28,913 [102] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:11:28 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:10:29,384 [436] [DEBUG] [app] Starting request: urn:request:734f70f5-15a3-433c-a502-79b96fc8faf0 (/health/instance) gunicorn-web stdout | 2020-07-23 07:10:29,387 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:10:29,392 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:10:29,395 [481] [DEBUG] [app] Starting request: urn:request:916214fc-bbf9-4f34-a65d-eb306de62a20 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:10:29,396 [481] [DEBUG] [app] Ending request: urn:request:916214fc-bbf9-4f34-a65d-eb306de62a20 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:10:29,397 [481] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:29 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:29 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:10:29,397 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:10:29,398 [436] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:10:29,404 [436] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:10:29,412 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:10:29,417 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:10:29,419 [436] [DEBUG] [app] Starting request: urn:request:695688fc-247e-4366-b9ef-a7d9ee81b016 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:10:29,421 [436] [DEBUG] [app] Ending request: urn:request:695688fc-247e-4366-b9ef-a7d9ee81b016 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:29 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:10:29,421 [436] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:29 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:10:29,422 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:10:29,426 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:29 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:10:29,426 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:10:29,429 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:10:29,431 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:29 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:10:29,435 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:10:29,436 [459] [DEBUG] [app] Starting request: urn:request:e7bc0ec7-5dcc-4122-9fb4-2efbf9b1e284 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:10:29,437 [459] [DEBUG] [app] Ending request: urn:request:e7bc0ec7-5dcc-4122-9fb4-2efbf9b1e284 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:29 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:10:29,438 [459] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:29 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:10:29,438 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:10:29,441 [436] [DEBUG] [app] Ending request: urn:request:734f70f5-15a3-433c-a502-79b96fc8faf0 (/health/instance) 2020-07-23 07:10:29,441 [436] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:10:29,442 [436] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:10:29 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:10:29 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.060 49 0.060) notificationworker stdout | 2020-07-23 07:10:29,915 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:10:29,916 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:39.911177+00:00 (in 9.995423 seconds) 2020-07-23 07:10:29,916 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:10:39 UTC)" (scheduled at 2020-07-23 07:10:29.911177+00:00) 2020-07-23 07:10:29,916 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:10:29,919 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 10, 29, 916808), True, datetime.datetime(2020, 7, 23, 7, 10, 29, 916808), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:10:29,928 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:10:29,929 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:10:29,929 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:10:39 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:10:30,353 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:10:30,354 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:52.446816+00:00 (in 22.093180 seconds) 2020-07-23 07:10:30,354 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:11:00 UTC)" (scheduled at 2020-07-23 07:10:30.351857+00:00) security_notification_worker stdout | 2020-07-23 07:10:30,354 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:10:30,356 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 10, 30, 354743), True, datetime.datetime(2020, 7, 23, 7, 10, 30, 354743), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:10:30,366 [101] [DEBUG] [workers.queueworker] No more work. security_notification_worker stdout | 2020-07-23 07:10:30,367 [101] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:10:30,367 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:11:00 UTC)" executed successfully builder stdout | 2020-07-23 07:10:30,943 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:10:30,955 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:10:30,955 [130] [DEBUG] [data.database] Disconnecting from database. securityworker stdout | 2020-07-23 07:10:33,478 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run securityworker stdout | 2020-07-23 07:10:33,478 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:11:03.476607+00:00 (in 29.998101 seconds) 2020-07-23 07:10:33,479 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:11:03 UTC)" (scheduled at 2020-07-23 07:10:33.476607+00:00) 2020-07-23 07:10:33,479 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:11:03 UTC)" executed successfully gcworker stdout | 2020-07-23 07:10:34,759 [110] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'gcworker.py', 'pid': '110'} expiredappspecifictokenworker stdout | 2020-07-23 07:10:35,128 [126] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '126'} securityworker stdout | 2020-07-23 07:10:35,767 [128] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'securityworker.py', 'pid': '128'} teamsyncworker stdout | 2020-07-23 07:10:36,094 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'teamsyncworker.py', 'pid': '115'} exportactionlogsworker stdout | 2020-07-23 07:10:37,500 [99] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'exportactionlogsworker.py', 'pid': '99'} gunicorn-secscan stdout | 2020-07-23 07:10:37,891 [413] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '413'} gunicorn-secscan stdout | 2020-07-23 07:10:37,903 [412] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '412'} queuecleanupworker stdout | 2020-07-23 07:10:37,907 [103] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'queuecleanupworker.py', 'pid': '103'} gunicorn-secscan stdout | 2020-07-23 07:10:37,919 [122] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '122'} gunicorn-secscan stdout | 2020-07-23 07:10:37,925 [411] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '411'} gunicorn-secscan stdout | 2020-07-23 07:10:37,934 [414] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '414'} repositoryactioncounter stdout | 2020-07-23 07:10:38,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:10:38,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:48.291018+00:00 (in 9.999020 seconds) 2020-07-23 07:10:38,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:10:48 UTC)" (scheduled at 2020-07-23 07:10:38.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:10:38,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:10:38,304 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:10:38,304 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:10:38,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:10:48 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:10:38,383 [438] [DEBUG] [app] Starting request: urn:request:109c5b5d-8b56-4382-af4e-737f99aff747 (/health/instance) gunicorn-web stdout | 2020-07-23 07:10:38,386 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:10:38,392 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:10:38,395 [481] [DEBUG] [app] Starting request: urn:request:3ae05e51-9aa3-4a2d-bc8f-1e1ff731caec (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:10:38,396 [481] [DEBUG] [app] Ending request: urn:request:3ae05e51-9aa3-4a2d-bc8f-1e1ff731caec (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:10:38,397 [481] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:38 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:38 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:10:38,397 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:10:38,399 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:10:38,408 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:10:38,420 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:10:38,426 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:10:38,428 [438] [DEBUG] [app] Starting request: urn:request:a39823be-0abc-4cb4-a16d-0332ffd8421a (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:10:38,429 [438] [DEBUG] [app] Ending request: urn:request:a39823be-0abc-4cb4-a16d-0332ffd8421a (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:10:38,429 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:38 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:38 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:10:38,430 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:10:38,434 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:10:38,435 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:38 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:10:38,438 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:38 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:10:38,440 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:10:38,445 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:10:38,447 [459] [DEBUG] [app] Starting request: urn:request:989d5a15-f13d-4396-85fa-3a245566237b (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:10:38,448 [459] [DEBUG] [app] Ending request: urn:request:989d5a15-f13d-4396-85fa-3a245566237b (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:10:38,449 [459] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:38 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:38 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.005 162 0.005) gunicorn-web stdout | 2020-07-23 07:10:38,452 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:10:38,454 [438] [DEBUG] [app] Ending request: urn:request:109c5b5d-8b56-4382-af4e-737f99aff747 (/health/instance) gunicorn-web stdout | 2020-07-23 07:10:38,454 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:10:38,455 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:10:38 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:10:38 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.074 49 0.074) globalpromstats stdout | 2020-07-23 07:10:38,774 [129] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'globalpromstats.py', 'pid': '129'} namespacegcworker stdout | 2020-07-23 07:10:39,026 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:10:39,026 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:11:06.910005+00:00 (in 27.883419 seconds) 2020-07-23 07:10:39,027 [134] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:11:39 UTC)" (scheduled at 2020-07-23 07:10:39.024941+00:00) 2020-07-23 07:10:39,027 [134] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:10:39,027 [134] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:11:39 UTC)" executed successfully buildlogsarchiver stdout | 2020-07-23 07:10:39,110 [109] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'buildlogsarchiver.py', 'pid': '109'} notificationworker stdout | 2020-07-23 07:10:39,365 [113] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'notificationworker.py', 'pid': '113'} gunicorn-web stdout | 2020-07-23 07:10:39,385 [438] [DEBUG] [app] Starting request: urn:request:eee87f1c-996c-425c-b168-314f9914632a (/health/instance) gunicorn-web stdout | 2020-07-23 07:10:39,389 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:10:39,391 [481] [DEBUG] [app] Starting request: urn:request:c9d887cd-1b3e-4d8a-9dae-1e2e3328f1f5 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:10:39,392 [481] [DEBUG] [app] Ending request: urn:request:c9d887cd-1b3e-4d8a-9dae-1e2e3328f1f5 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-registry stdout | 2020-07-23 07:10:39,393 [481] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:10:39,393 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:10:39,394 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:10:39,401 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:10:39,410 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:10:39,415 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:10:39,417 [419] [DEBUG] [app] Starting request: urn:request:d595efbc-42ca-4cef-806f-72c6ee3bfef0 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:10:39,418 [419] [DEBUG] [app] Ending request: urn:request:d595efbc-42ca-4cef-806f-72c6ee3bfef0 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:10:39,419 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:10:39,419 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:10:39,423 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:39 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:10:39,424 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:10:39,428 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:10:39,429 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:39 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:10:39,433 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:10:39,435 [461] [DEBUG] [app] Starting request: urn:request:8b5f7b8b-cd1a-4b22-9780-dd5a95e8134c (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:10:39,436 [461] [DEBUG] [app] Ending request: urn:request:8b5f7b8b-cd1a-4b22-9780-dd5a95e8134c (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:39 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:10:39,437 [461] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:39 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:10:39,437 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:10:39,439 [438] [DEBUG] [app] Ending request: urn:request:eee87f1c-996c-425c-b168-314f9914632a (/health/instance) gunicorn-web stdout | 2020-07-23 07:10:39,439 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:10:39,440 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:10:39 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:10:39 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.056 49 0.056) chunkcleanupworker stdout | 2020-07-23 07:10:39,572 [124] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'chunkcleanupworker.py', 'pid': '124'} notificationworker stdout | 2020-07-23 07:10:39,914 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:10:39,915 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:49.911177+00:00 (in 9.995970 seconds) 2020-07-23 07:10:39,915 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:10:49 UTC)" (scheduled at 2020-07-23 07:10:39.911177+00:00) 2020-07-23 07:10:39,916 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:10:39,918 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 10, 39, 916242), True, datetime.datetime(2020, 7, 23, 7, 10, 39, 916242), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:10:39,928 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:10:39,928 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:10:39,928 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:10:49 UTC)" executed successfully gcworker stdout | 2020-07-23 07:10:40,005 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2020-07-23 07:10:40,006 [110] [INFO] [apscheduler.executors.default] Running job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:11:10 UTC)" (scheduled at 2020-07-23 07:10:40.004697+00:00) gcworker stdout | 2020-07-23 07:10:40,007 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:11:10.004697+00:00 (in 29.999084 seconds) gcworker stdout | 2020-07-23 07:10:40,009 [110] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1594278640006, 1209600, 500, 1, 0]) gcworker stdout | 2020-07-23 07:10:40,019 [110] [DEBUG] [__main__] No repository with garbage found 2020-07-23 07:10:40,020 [110] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2020-07-23 07:10:40,020 [110] [INFO] [apscheduler.executors.default] Job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:11:10 UTC)" executed successfully builder stdout | 2020-07-23 07:10:40,856 [130] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'builder.py', 'pid': '130'} builder stdout | 2020-07-23 07:10:40,965 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:10:40,981 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:10:40,981 [130] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:10:41,071 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositorygcworker.py', 'pid': '102'} namespacegcworker stdout | 2020-07-23 07:10:41,089 [134] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'namespacegcworker.py', 'pid': '134'} blobuploadcleanupworker stdout | 2020-07-23 07:10:41,556 [119] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'blobuploadcleanupworker.py', 'pid': '119'} security_notification_worker stdout | 2020-07-23 07:10:43,044 [101] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'security_notification_worker.py', 'pid': '101'} logrotateworker stdout | 2020-07-23 07:10:43,103 [118] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'logrotateworker.py', 'pid': '118'} storagereplication stdout | 2020-07-23 07:10:43,124 [133] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'storagereplication.py', 'pid': '133'} repositoryactioncounter stdout | 2020-07-23 07:10:44,450 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositoryactioncounter.py', 'pid': '114'} servicekey stdout | 2020-07-23 07:10:45,090 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'servicekeyworker.py', 'pid': '98'} gunicorn-web stdout | 2020-07-23 07:10:45,761 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '104'} gunicorn-web stdout | 2020-07-23 07:10:45,773 [435] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '435'} gunicorn-web stdout | 2020-07-23 07:10:45,785 [419] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '419'} gunicorn-web stdout | 2020-07-23 07:10:45,794 [438] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '438'} gunicorn-web stdout | 2020-07-23 07:10:45,801 [433] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '433'} gunicorn-web stdout | 2020-07-23 07:10:45,824 [431] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '431'} gunicorn-web stdout | 2020-07-23 07:10:45,831 [436] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '436'} gunicorn-web stdout | 2020-07-23 07:10:45,835 [420] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '420'} gunicorn-web stdout | 2020-07-23 07:10:45,843 [423] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '423'} repositoryactioncounter stdout | 2020-07-23 07:10:48,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:10:48,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:58.291018+00:00 (in 9.998906 seconds) 2020-07-23 07:10:48,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:10:58 UTC)" (scheduled at 2020-07-23 07:10:48.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:10:48,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:10:48,303 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:10:48,304 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:10:48,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:10:58 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:10:48,382 [435] [DEBUG] [app] Starting request: urn:request:1e9dab30-1d88-4f5e-9b7f-4d03e0a23d75 (/health/instance) gunicorn-web stdout | 2020-07-23 07:10:48,385 [435] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:10:48,391 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:10:48,392 [470] [DEBUG] [app] Starting request: urn:request:0e4e7032-370c-4fdb-b3d8-f886ef24b419 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:10:48,394 [470] [DEBUG] [app] Ending request: urn:request:0e4e7032-370c-4fdb-b3d8-f886ef24b419 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-registry stdout | 2020-07-23 07:10:48,395 [470] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:10:48,395 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:10:48,396 [435] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:10:48,403 [435] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:10:48,412 [435] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:10:48,417 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:10:48,421 [436] [DEBUG] [app] Starting request: urn:request:8718a135-59ce-4a6e-a206-697a6230a82f (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:10:48,422 [436] [DEBUG] [app] Ending request: urn:request:8718a135-59ce-4a6e-a206-697a6230a82f (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:48 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:10:48,423 [436] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:48 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:10:48,423 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:10:48,428 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:48 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:10:48,429 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:10:48,433 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:10:48,434 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:48 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:10:48,438 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:10:48,440 [459] [DEBUG] [app] Starting request: urn:request:1b3aab14-4293-4b38-b362-ac8f16bc5f2c (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:10:48,441 [459] [DEBUG] [app] Ending request: urn:request:1b3aab14-4293-4b38-b362-ac8f16bc5f2c (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:48 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:10:48,442 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:10:48,442 [459] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:48 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:10:48,444 [435] [DEBUG] [app] Ending request: urn:request:1e9dab30-1d88-4f5e-9b7f-4d03e0a23d75 (/health/instance) gunicorn-web stdout | 2020-07-23 07:10:48,444 [435] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:10:48,445 [435] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:10:48 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:10:48 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.064 49 0.064) gunicorn-web stdout | 2020-07-23 07:10:49,385 [419] [DEBUG] [app] Starting request: urn:request:7c4cb148-1071-4bfc-a15d-1685034abf84 (/health/instance) gunicorn-web stdout | 2020-07-23 07:10:49,388 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:10:49,394 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:10:49,396 [470] [DEBUG] [app] Starting request: urn:request:aa5c2979-edfb-43c1-b816-557dd67a05cc (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:10:49,397 [470] [DEBUG] [app] Ending request: urn:request:aa5c2979-edfb-43c1-b816-557dd67a05cc (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:49 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-registry stdout | 2020-07-23 07:10:49,398 [470] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:49 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:10:49,399 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:10:49,400 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:10:49,407 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:10:49,415 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:10:49,420 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:10:49,423 [438] [DEBUG] [app] Starting request: urn:request:e850dc6a-e5cd-4bf4-ac2b-cccb52d3c38c (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:10:49,424 [438] [DEBUG] [app] Ending request: urn:request:e850dc6a-e5cd-4bf4-ac2b-cccb52d3c38c (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:10:49,425 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:49 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:10:49,425 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:49 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:10:49,429 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:49 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:10:49,430 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:10:49,434 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:49 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:10:49,436 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:10:49,440 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:10:49,442 [459] [DEBUG] [app] Starting request: urn:request:5a3d192c-dc02-497f-98c8-23609d59dba1 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:10:49,443 [459] [DEBUG] [app] Ending request: urn:request:5a3d192c-dc02-497f-98c8-23609d59dba1 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:49 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-verbs stdout | 2020-07-23 07:10:49,444 [459] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:49 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:10:49,444 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:10:49,446 [419] [DEBUG] [app] Ending request: urn:request:7c4cb148-1071-4bfc-a15d-1685034abf84 (/health/instance) gunicorn-web stdout | 2020-07-23 07:10:49,447 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:10:49,447 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:10:49 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:10:49 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.064 49 0.064) notificationworker stdout | 2020-07-23 07:10:49,912 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:10:49,913 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:10:59.911177+00:00 (in 9.998555 seconds) 2020-07-23 07:10:49,913 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:10:59 UTC)" (scheduled at 2020-07-23 07:10:49.911177+00:00) 2020-07-23 07:10:49,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:10:49,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 10, 49, 913727), True, datetime.datetime(2020, 7, 23, 7, 10, 49, 913727), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:10:49,926 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:10:49,927 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:10:49,927 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:10:59 UTC)" executed successfully builder stdout | 2020-07-23 07:10:50,680 [130] [DEBUG] [buildman.server] Writing metrics builder stdout | 2020-07-23 07:10:50,698 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds builder stdout | 2020-07-23 07:10:50,983 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:10:50,991 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:10:50,992 [130] [DEBUG] [data.database] Disconnecting from database. security_notification_worker stdout | 2020-07-23 07:10:52,451 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:10:52,451 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:11:00.351857+00:00 (in 7.900647 seconds) 2020-07-23 07:10:52,451 [101] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:11:52 UTC)" (scheduled at 2020-07-23 07:10:52.446816+00:00) 2020-07-23 07:10:52,452 [101] [DEBUG] [workers.queueworker] Running watchdog. security_notification_worker stdout | 2020-07-23 07:10:52,452 [101] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:11:52 UTC)" executed successfully gunicorn-registry stdout | 2020-07-23 07:10:52,467 [469] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '469'} gunicorn-registry stdout | 2020-07-23 07:10:52,494 [100] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '100'} gunicorn-registry stdout | 2020-07-23 07:10:52,498 [463] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '463'} gunicorn-registry stdout | 2020-07-23 07:10:52,512 [477] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '477'} gunicorn-registry stdout | 2020-07-23 07:10:52,532 [478] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '478'} gunicorn-registry stdout | 2020-07-23 07:10:52,539 [470] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '470'} gunicorn-registry stdout | 2020-07-23 07:10:52,544 [480] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '480'} gunicorn-registry stdout | 2020-07-23 07:10:52,561 [476] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '476'} gunicorn-registry stdout | 2020-07-23 07:10:52,575 [467] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '467'} gunicorn-registry stdout | 2020-07-23 07:10:52,579 [475] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '475'} gunicorn-registry stdout | 2020-07-23 07:10:52,583 [479] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '479'} gunicorn-registry stdout | 2020-07-23 07:10:52,588 [472] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '472'} gunicorn-registry stdout | 2020-07-23 07:10:52,596 [474] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '474'} gunicorn-registry stdout | 2020-07-23 07:10:52,606 [473] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '473'} gunicorn-registry stdout | 2020-07-23 07:10:52,611 [465] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '465'} gunicorn-registry stdout | 2020-07-23 07:10:52,621 [471] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '471'} gunicorn-registry stdout | 2020-07-23 07:10:52,626 [481] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '481'} gunicorn-verbs stdout | 2020-07-23 07:10:53,386 [127] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'verbs:application', 'pid': '127'} buildlogsarchiver stdout | 2020-07-23 07:10:56,396 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:10:56,396 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:11:26.395393+00:00 (in 29.998925 seconds) 2020-07-23 07:10:56,397 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:11:26 UTC)" (scheduled at 2020-07-23 07:10:56.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:10:56,399 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 10, 56, 397446), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:10:56,408 [109] [DEBUG] [__main__] No more builds to archive 2020-07-23 07:10:56,408 [109] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2020-07-23 07:10:56,408 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:11:26 UTC)" executed successfully exportactionlogsworker stdout | 2020-07-23 07:10:57,210 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:10:57,211 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:11:03.971686+00:00 (in 6.760890 seconds) 2020-07-23 07:10:57,211 [99] [INFO] [apscheduler.executors.default] Running job "update_queue_metrics (trigger: interval[0:05:00], next run at: 2020-07-23 07:15:57 UTC)" (scheduled at 2020-07-23 07:10:57.209762+00:00) exportactionlogsworker stdout | 2020-07-23 07:10:57,213 [99] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2020, 7, 23, 7, 10, 57, 211701), u'exportactionlogs/%']) exportactionlogsworker stdout | 2020-07-23 07:10:57,221 [99] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2020, 7, 23, 7, 10, 57, 211701), True, datetime.datetime(2020, 7, 23, 7, 10, 57, 211701), 0, u'exportactionlogs/%']) exportactionlogsworker stdout | 2020-07-23 07:10:57,225 [99] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2020, 7, 23, 7, 10, 57, 211701), True, datetime.datetime(2020, 7, 23, 7, 10, 57, 211701), 0, u'exportactionlogs/%', False, datetime.datetime(2020, 7, 23, 7, 10, 57, 211701), u'exportactionlogs/%']) exportactionlogsworker stdout | 2020-07-23 07:10:57,227 [99] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2020-07-23 07:10:57,228 [99] [INFO] [apscheduler.executors.default] Job "update_queue_metrics (trigger: interval[0:05:00], next run at: 2020-07-23 07:15:57 UTC)" executed successfully repositoryactioncounter stdout | 2020-07-23 07:10:58,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:10:58,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:11:08.291018+00:00 (in 9.999064 seconds) repositoryactioncounter stdout | 2020-07-23 07:10:58,294 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:11:08 UTC)" (scheduled at 2020-07-23 07:10:58.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:10:58,296 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:10:58,304 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:10:58,304 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:10:58,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:11:08 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:10:58,383 [419] [DEBUG] [app] Starting request: urn:request:ba02c42a-8034-4d5e-82be-28132029a79b (/health/instance) gunicorn-web stdout | 2020-07-23 07:10:58,386 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:10:58,391 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:10:58,392 [477] [DEBUG] [app] Starting request: urn:request:1ba031d8-8199-4b3b-8500-a39d5ff73ed6 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:10:58,393 [477] [DEBUG] [app] Ending request: urn:request:1ba031d8-8199-4b3b-8500-a39d5ff73ed6 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:10:58,394 [477] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:10:58,394 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:10:58,396 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:10:58,402 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:10:58,410 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:10:58,415 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:10:58,417 [419] [DEBUG] [app] Starting request: urn:request:12bd404d-f615-405c-bca2-9aaca9f7f132 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:10:58,418 [419] [DEBUG] [app] Ending request: urn:request:12bd404d-f615-405c-bca2-9aaca9f7f132 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:58 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:10:58,419 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:58 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:10:58,420 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:10:58,423 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:58 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:10:58,424 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:10:58,428 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:58 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:10:58,429 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:10:58,433 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:10:58,435 [466] [DEBUG] [app] Starting request: urn:request:896c03c6-bf4c-420c-b731-c0df92e69ba8 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:10:58,436 [466] [DEBUG] [app] Ending request: urn:request:896c03c6-bf4c-420c-b731-c0df92e69ba8 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:58 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 162 0.002) gunicorn-verbs stdout | 2020-07-23 07:10:58,437 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:58 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:10:58,437 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:10:58,439 [419] [DEBUG] [app] Ending request: urn:request:ba02c42a-8034-4d5e-82be-28132029a79b (/health/instance) gunicorn-web stdout | 2020-07-23 07:10:58,440 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:10:58,440 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:10:58 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:10:58 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.060 49 0.060) gunicorn-web stdout | 2020-07-23 07:10:59,385 [419] [DEBUG] [app] Starting request: urn:request:088af7bf-d5ff-48cd-b903-256044f84247 (/health/instance) gunicorn-web stdout | 2020-07-23 07:10:59,388 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:10:59,390 [474] [DEBUG] [app] Starting request: urn:request:44531f3f-f0ad-4351-837a-7ce726bd50fe (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:10:59,391 [474] [DEBUG] [app] Ending request: urn:request:44531f3f-f0ad-4351-837a-7ce726bd50fe (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:10:59,392 [474] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:59 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:59 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:10:59,393 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:10:59,394 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:10:59,400 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:10:59,409 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:10:59,414 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:10:59,416 [436] [DEBUG] [app] Starting request: urn:request:bdcc0f8c-dcad-41b9-ba85-b8ef54264cc1 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:10:59,417 [436] [DEBUG] [app] Ending request: urn:request:bdcc0f8c-dcad-41b9-ba85-b8ef54264cc1 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:10:59,418 [436] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:59 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:59 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:10:59,418 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:10:59,423 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:59 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:10:59,424 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:10:59,428 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:10:59,429 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:59 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:10:59,434 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:10:59,439 [468] [DEBUG] [app] Starting request: urn:request:a451f8f3-cbad-425e-9b8f-6428249b356f (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:10:59,443 [468] [DEBUG] [app] Ending request: urn:request:a451f8f3-cbad-425e-9b8f-6428249b356f (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:10:59 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.009 162 0.009) gunicorn-web stdout | 2020-07-23 07:10:59,445 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:10:59,444 [468] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:10:59 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:10:59,447 [419] [DEBUG] [app] Ending request: urn:request:088af7bf-d5ff-48cd-b903-256044f84247 (/health/instance) 2020-07-23 07:10:59,447 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:10:59,448 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:10:59 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:10:59 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.064 49 0.064) notificationworker stdout | 2020-07-23 07:10:59,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:10:59,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:11:09.911177+00:00 (in 9.999011 seconds) 2020-07-23 07:10:59,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:11:09 UTC)" (scheduled at 2020-07-23 07:10:59.911177+00:00) 2020-07-23 07:10:59,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:10:59,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 10, 59, 913215), True, datetime.datetime(2020, 7, 23, 7, 10, 59, 913215), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:10:59,924 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:10:59,924 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:10:59,924 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:11:09 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:11:00,352 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:11:00,353 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:11:30.351857+00:00 (in 29.998884 seconds) 2020-07-23 07:11:00,353 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:11:30 UTC)" (scheduled at 2020-07-23 07:11:00.351857+00:00) 2020-07-23 07:11:00,354 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:11:00,356 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 11, 0, 354148), True, datetime.datetime(2020, 7, 23, 7, 11, 0, 354148), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:11:00,364 [101] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:11:00,364 [101] [DEBUG] [data.database] Disconnecting from database. security_notification_worker stdout | 2020-07-23 07:11:00,365 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:11:30 UTC)" executed successfully builder stdout | 2020-07-23 07:11:01,001 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:11:01,016 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:11:01,016 [130] [DEBUG] [data.database] Disconnecting from database. securityworker stdout | 2020-07-23 07:11:03,477 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run securityworker stdout | 2020-07-23 07:11:03,477 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:11:33.476607+00:00 (in 29.999087 seconds) 2020-07-23 07:11:03,478 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:11:33 UTC)" (scheduled at 2020-07-23 07:11:03.476607+00:00) securityworker stdout | 2020-07-23 07:11:03,479 [128] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "image" AS "t1" WHERE ("t1"."security_indexed_engine" < %s)', [3]) securityworker stdout | 2020-07-23 07:11:03,486 [128] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "image" AS "t1"', []) securityworker stdout | 2020-07-23 07:11:03,488 [128] [DEBUG] [data.secscan_model.secscan_v2_model] Found no additional images to scan 2020-07-23 07:11:03,488 [128] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:11:03,488 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:11:33 UTC)" executed successfully exportactionlogsworker stdout | 2020-07-23 07:11:03,972 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:11:03,972 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:11:08.212267+00:00 (in 4.239615 seconds) 2020-07-23 07:11:03,973 [99] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:12:03 UTC)" (scheduled at 2020-07-23 07:11:03.971686+00:00) 2020-07-23 07:11:03,973 [99] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2020-07-23 07:11:03,975 [99] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 11, 3, 973502), True, datetime.datetime(2020, 7, 23, 7, 11, 3, 973502), 0, u'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2020-07-23 07:11:03,984 [99] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:11:03,984 [99] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2020-07-23 07:11:03,984 [99] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:12:03 UTC)" executed successfully gcworker stdout | 2020-07-23 07:11:04,798 [110] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'gcworker.py', 'pid': '110'} expiredappspecifictokenworker stdout | 2020-07-23 07:11:05,168 [126] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '126'} securityworker stdout | 2020-07-23 07:11:05,807 [128] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'securityworker.py', 'pid': '128'} teamsyncworker stdout | 2020-07-23 07:11:06,133 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'teamsyncworker.py', 'pid': '115'} namespacegcworker stdout | 2020-07-23 07:11:06,920 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:11:06,921 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:11:39.024941+00:00 (in 32.103820 seconds) 2020-07-23 07:11:06,970 [134] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:12:06 UTC)" (scheduled at 2020-07-23 07:11:06.910005+00:00) 2020-07-23 07:11:06,970 [134] [DEBUG] [workers.queueworker] Getting work item from queue. 2020-07-23 07:11:06,973 [134] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 11, 6, 971054), True, datetime.datetime(2020, 7, 23, 7, 11, 6, 971054), 0, u'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2020-07-23 07:11:07,037 [134] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:11:07,037 [134] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:11:07,037 [134] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:12:06 UTC)" executed successfully exportactionlogsworker stdout | 2020-07-23 07:11:07,540 [99] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'exportactionlogsworker.py', 'pid': '99'} gunicorn-secscan stdout | 2020-07-23 07:11:07,901 [413] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '413'} gunicorn-secscan stdout | 2020-07-23 07:11:07,915 [412] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '412'} gunicorn-secscan stdout | 2020-07-23 07:11:07,929 [122] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '122'} gunicorn-secscan stdout | 2020-07-23 07:11:07,936 [411] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '411'} gunicorn-secscan stdout | 2020-07-23 07:11:07,947 [414] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '414'} queuecleanupworker stdout | 2020-07-23 07:11:07,952 [103] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'queuecleanupworker.py', 'pid': '103'} exportactionlogsworker stdout | 2020-07-23 07:11:08,213 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:11:08,213 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:03.971686+00:00 (in 55.758442 seconds) 2020-07-23 07:11:08,213 [99] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:12:08 UTC)" (scheduled at 2020-07-23 07:11:08.212267+00:00) 2020-07-23 07:11:08,214 [99] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:11:08,214 [99] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:12:08 UTC)" executed successfully repositoryactioncounter stdout | 2020-07-23 07:11:08,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:11:08,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:11:18 UTC)" (scheduled at 2020-07-23 07:11:08.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:11:08,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:11:18.291018+00:00 (in 9.999186 seconds) repositoryactioncounter stdout | 2020-07-23 07:11:08,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:11:08,303 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:11:08,303 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:11:08,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:11:18 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:11:08,382 [436] [DEBUG] [app] Starting request: urn:request:58f56e78-03c6-41a8-b689-a9a0c32d7e91 (/health/instance) gunicorn-web stdout | 2020-07-23 07:11:08,386 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:11:08,392 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:11:08,394 [476] [DEBUG] [app] Starting request: urn:request:90155bcd-b08d-4eda-a263-508df8f6884c (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:11:08,395 [476] [DEBUG] [app] Ending request: urn:request:90155bcd-b08d-4eda-a263-508df8f6884c (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:11:08,396 [476] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:08 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:08 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:11:08,396 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:11:08,398 [436] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:11:08,404 [436] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:11:08,413 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:11:08,419 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:11:08,421 [436] [DEBUG] [app] Starting request: urn:request:8b9355a0-517a-4647-8114-15bd8cf874d3 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:11:08,422 [436] [DEBUG] [app] Ending request: urn:request:8b9355a0-517a-4647-8114-15bd8cf874d3 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:11:08,423 [436] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:08 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:08 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:11:08,423 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:11:08,428 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:08 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:11:08,429 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:11:08,432 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:08 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:11:08,434 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:11:08,439 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:11:08,441 [459] [DEBUG] [app] Starting request: urn:request:2eecf14d-a509-46d3-a27f-b2df16daf063 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:11:08,443 [459] [DEBUG] [app] Ending request: urn:request:2eecf14d-a509-46d3-a27f-b2df16daf063 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:11:08,445 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:11:08,444 [459] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:08 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:08 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.005 162 0.005) gunicorn-web stdout | 2020-07-23 07:11:08,447 [436] [DEBUG] [app] Ending request: urn:request:58f56e78-03c6-41a8-b689-a9a0c32d7e91 (/health/instance) 2020-07-23 07:11:08,447 [436] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:11:08 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.067 49 0.067) gunicorn-web stdout | 2020-07-23 07:11:08,448 [436] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:11:08 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" globalpromstats stdout | 2020-07-23 07:11:08,812 [129] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'globalpromstats.py', 'pid': '129'} buildlogsarchiver stdout | 2020-07-23 07:11:09,149 [109] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'buildlogsarchiver.py', 'pid': '109'} gunicorn-web stdout | 2020-07-23 07:11:09,385 [419] [DEBUG] [app] Starting request: urn:request:4fe312d2-36a9-49c5-8a16-832bf3b29e89 (/health/instance) gunicorn-web stdout | 2020-07-23 07:11:09,388 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:11:09,393 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:11:09,396 [478] [DEBUG] [app] Starting request: urn:request:f98fbb00-4364-4c7a-abcd-e47cdb539eec (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:11:09,397 [478] [DEBUG] [app] Ending request: urn:request:f98fbb00-4364-4c7a-abcd-e47cdb539eec (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:11:09,398 [478] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:11:09,399 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:11:09,400 [419] [INFO] [data.database] Connection pooling disabled for postgresql notificationworker stdout | 2020-07-23 07:11:09,405 [113] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'notificationworker.py', 'pid': '113'} gunicorn-web stdout | 2020-07-23 07:11:09,406 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:11:09,415 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:11:09,421 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:11:09,423 [419] [DEBUG] [app] Starting request: urn:request:cde1e411-db2c-47bd-ae02-9a4787540cdf (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:11:09,424 [419] [DEBUG] [app] Ending request: urn:request:cde1e411-db2c-47bd-ae02-9a4787540cdf (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:11:09,425 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:11:09,426 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:11:09,430 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:09 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:11:09,431 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:11:09,434 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:09 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:11:09,436 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:11:09,440 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:11:09,441 [459] [DEBUG] [app] Starting request: urn:request:821e5b21-a5b7-4b69-8901-b4694b628341 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:11:09,443 [459] [DEBUG] [app] Ending request: urn:request:821e5b21-a5b7-4b69-8901-b4694b628341 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:09 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:11:09,443 [459] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:09 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:11:09,444 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 2020-07-23 07:11:09,445 [419] [DEBUG] [app] Ending request: urn:request:4fe312d2-36a9-49c5-8a16-832bf3b29e89 (/health/instance) 2020-07-23 07:11:09,446 [419] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:11:09 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.063 49 0.063) gunicorn-web stdout | 2020-07-23 07:11:09,446 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:11:09 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" chunkcleanupworker stdout | 2020-07-23 07:11:09,612 [124] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'chunkcleanupworker.py', 'pid': '124'} notificationworker stdout | 2020-07-23 07:11:09,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:11:09,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:11:11.998621+00:00 (in 2.086465 seconds) 2020-07-23 07:11:09,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:11:19 UTC)" (scheduled at 2020-07-23 07:11:09.911177+00:00) 2020-07-23 07:11:09,912 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:11:09,914 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 11, 9, 913001), True, datetime.datetime(2020, 7, 23, 7, 11, 9, 913001), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:11:09,923 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:11:09,923 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:11:09,923 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:11:19 UTC)" executed successfully gcworker stdout | 2020-07-23 07:11:10,008 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2020-07-23 07:11:10,009 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:11:40.004697+00:00 (in 29.995584 seconds) 2020-07-23 07:11:10,009 [110] [INFO] [apscheduler.executors.default] Running job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:11:40 UTC)" (scheduled at 2020-07-23 07:11:10.004697+00:00) gcworker stdout | 2020-07-23 07:11:10,012 [110] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1594278670010, 1209600, 500, 1, 0]) gcworker stdout | 2020-07-23 07:11:10,022 [110] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2020-07-23 07:11:10,023 [110] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:11:10,023 [110] [INFO] [apscheduler.executors.default] Job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:11:40 UTC)" executed successfully builder stdout | 2020-07-23 07:11:10,896 [130] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'builder.py', 'pid': '130'} builder stdout | 2020-07-23 07:11:11,023 [130] [DEBUG] [buildman.server] Checking for more work for 0 active workers builder stdout | 2020-07-23 07:11:11,045 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:11:11,046 [130] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:11:11,126 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositorygcworker.py', 'pid': '102'} namespacegcworker stdout | 2020-07-23 07:11:11,133 [134] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'namespacegcworker.py', 'pid': '134'} builder stdout | 2020-07-23 07:11:11,291 [130] [DEBUG] [buildman.server] Registering component with realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:11:11,292 [130] [DEBUG] [buildman.manager.enterprise] Registering new build component+worker with realm bbb37ba9-57a1-4883-a8e6-b99378195e48 2020-07-23 07:11:11,292 [130] [DEBUG] [buildman.component.buildcomponent] Registering methods and listeners for component bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:11:11,461 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:11:11,461 [130] [DEBUG] [buildman.component.buildcomponent] On ready called (token "") 2020-07-23 07:11:11,462 [130] [DEBUG] [buildman.component.buildcomponent] Build worker bbb37ba9-57a1-4883-a8e6-b99378195e48 is connected and ready blobuploadcleanupworker stdout | 2020-07-23 07:11:11,596 [119] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'blobuploadcleanupworker.py', 'pid': '119'} notificationworker stdout | 2020-07-23 07:11:11,999 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:11:12,000 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:11:19.911177+00:00 (in 7.911458 seconds) 2020-07-23 07:11:12,000 [113] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:12:11 UTC)" (scheduled at 2020-07-23 07:11:11.998621+00:00) 2020-07-23 07:11:12,000 [113] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:11:12,000 [113] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:12:11 UTC)" executed successfully builder stdout | 2020-07-23 07:11:12,461 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 security_notification_worker stdout | 2020-07-23 07:11:13,082 [101] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'security_notification_worker.py', 'pid': '101'} logrotateworker stdout | 2020-07-23 07:11:13,139 [118] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'logrotateworker.py', 'pid': '118'} storagereplication stdout | 2020-07-23 07:11:13,162 [133] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'storagereplication.py', 'pid': '133'} builder stdout | 2020-07-23 07:11:13,461 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:11:14,462 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:11:14,488 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositoryactioncounter.py', 'pid': '114'} servicekey stdout | 2020-07-23 07:11:15,130 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'servicekeyworker.py', 'pid': '98'} builder stdout | 2020-07-23 07:11:15,462 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:11:15,773 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '104'} gunicorn-web stdout | 2020-07-23 07:11:15,784 [435] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '435'} gunicorn-web stdout | 2020-07-23 07:11:15,795 [419] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '419'} gunicorn-web stdout | 2020-07-23 07:11:15,804 [438] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '438'} gunicorn-web stdout | 2020-07-23 07:11:15,813 [433] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '433'} gunicorn-web stdout | 2020-07-23 07:11:15,835 [431] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '431'} gunicorn-web stdout | 2020-07-23 07:11:15,845 [436] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '436'} gunicorn-web stdout | 2020-07-23 07:11:15,850 [420] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '420'} gunicorn-web stdout | 2020-07-23 07:11:15,854 [423] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '423'} builder stdout | 2020-07-23 07:11:16,462 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:11:17,463 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:11:18,294 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:11:18,295 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:11:28.291018+00:00 (in 9.996171 seconds) 2020-07-23 07:11:18,295 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:11:28 UTC)" (scheduled at 2020-07-23 07:11:18.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:11:18,297 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:11:18,307 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:11:18,307 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:11:18,307 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:11:28 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:11:18,383 [419] [DEBUG] [app] Starting request: urn:request:ace6d2e8-6308-4089-a189-62091ee7d4d1 (/health/instance) gunicorn-web stdout | 2020-07-23 07:11:18,385 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:11:18,391 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:11:18,393 [471] [DEBUG] [app] Starting request: urn:request:ea063132-4dd4-42d4-b038-e5217ff0d5ce (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:11:18,394 [471] [DEBUG] [app] Ending request: urn:request:ea063132-4dd4-42d4-b038-e5217ff0d5ce (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:11:18,395 [471] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:18 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:18 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:11:18,395 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:11:18,396 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:11:18,402 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:11:18,412 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:11:18,417 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:11:18,419 [419] [DEBUG] [app] Starting request: urn:request:0763a741-4015-48e5-8a62-cb28a85f9148 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:11:18,420 [419] [DEBUG] [app] Ending request: urn:request:0763a741-4015-48e5-8a62-cb28a85f9148 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:11:18,421 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:18 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:18 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:11:18,422 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:11:18,426 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:18 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:11:18,427 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:11:18,430 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:11:18,432 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:18 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:11:18,436 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:11:18,438 [459] [DEBUG] [app] Starting request: urn:request:4377b605-ce4e-457b-808d-9b6e7da09df0 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:18 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:11:18,439 [459] [DEBUG] [app] Ending request: urn:request:4377b605-ce4e-457b-808d-9b6e7da09df0 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:11:18,440 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:11:18,439 [459] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:18 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:11:18,442 [419] [DEBUG] [app] Ending request: urn:request:ace6d2e8-6308-4089-a189-62091ee7d4d1 (/health/instance) 2020-07-23 07:11:18,442 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:11:18,443 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:11:18 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:11:18 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.061 49 0.061) builder stdout | 2020-07-23 07:11:18,463 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:11:19,384 [438] [DEBUG] [app] Starting request: urn:request:355f244d-3481-4220-9726-58070cd79b6d (/health/instance) gunicorn-web stdout | 2020-07-23 07:11:19,387 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:11:19,393 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:11:19,395 [465] [DEBUG] [app] Starting request: urn:request:6d1f84bd-ffec-49b5-9047-87e5a3325248 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:11:19,396 [465] [DEBUG] [app] Ending request: urn:request:6d1f84bd-ffec-49b5-9047-87e5a3325248 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:11:19,397 [465] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:19 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:19 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:11:19,397 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:11:19,399 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:11:19,405 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:11:19,413 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:11:19,419 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:11:19,421 [438] [DEBUG] [app] Starting request: urn:request:e099fc40-40bb-4a37-b453-ea8b143d9c15 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:11:19,421 [438] [DEBUG] [app] Ending request: urn:request:e099fc40-40bb-4a37-b453-ea8b143d9c15 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:11:19,422 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:19 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:19 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:11:19,423 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:11:19,427 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:19 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:11:19,427 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:11:19,431 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:11:19,432 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:19 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:11:19,436 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:11:19,438 [464] [DEBUG] [app] Starting request: urn:request:8f898c5f-6d58-4cca-9ec6-b4caeb951ef2 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:11:19,439 [464] [DEBUG] [app] Ending request: urn:request:8f898c5f-6d58-4cca-9ec6-b4caeb951ef2 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:11:19,441 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:19 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:11:19,440 [464] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:19 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:11:19,443 [438] [DEBUG] [app] Ending request: urn:request:355f244d-3481-4220-9726-58070cd79b6d (/health/instance) 2020-07-23 07:11:19,443 [438] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:11:19 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.060 49 0.060) gunicorn-web stdout | 2020-07-23 07:11:19,444 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:11:19 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" builder stdout | 2020-07-23 07:11:19,463 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:11:19,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:11:19,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:11:29.911177+00:00 (in 9.999008 seconds) 2020-07-23 07:11:19,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:11:29 UTC)" (scheduled at 2020-07-23 07:11:19.911177+00:00) 2020-07-23 07:11:19,912 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:11:19,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 11, 19, 912935), True, datetime.datetime(2020, 7, 23, 7, 11, 19, 912935), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:11:19,926 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:11:19,926 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:11:19,926 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:11:29 UTC)" executed successfully builder stdout | 2020-07-23 07:11:20,463 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:11:20,699 [130] [DEBUG] [buildman.server] Writing metrics builder stdout | 2020-07-23 07:11:20,713 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds builder stdout | 2020-07-23 07:11:21,047 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:11:21,055 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:11:21,055 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:11:21,463 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositorygcworker stdout | 2020-07-23 07:11:21,739 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:11:21,740 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:11:28.907644+00:00 (in 7.167510 seconds) 2020-07-23 07:11:21,740 [102] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:12:21 UTC)" (scheduled at 2020-07-23 07:11:21.739118+00:00) 2020-07-23 07:11:21,741 [102] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2020-07-23 07:11:21,743 [102] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 11, 21, 741251), True, datetime.datetime(2020, 7, 23, 7, 11, 21, 741251), 0, u'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2020-07-23 07:11:21,752 [102] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:11:21,752 [102] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:11:21,753 [102] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:12:21 UTC)" executed successfully builder stdout | 2020-07-23 07:11:22,464 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-registry stdout | 2020-07-23 07:11:22,482 [469] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '469'} gunicorn-registry stdout | 2020-07-23 07:11:22,508 [100] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '100'} gunicorn-registry stdout | 2020-07-23 07:11:22,514 [463] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '463'} gunicorn-registry stdout | 2020-07-23 07:11:22,525 [477] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '477'} gunicorn-registry stdout | 2020-07-23 07:11:22,545 [478] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '478'} gunicorn-registry stdout | 2020-07-23 07:11:22,555 [470] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '470'} gunicorn-registry stdout | 2020-07-23 07:11:22,559 [480] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '480'} gunicorn-registry stdout | 2020-07-23 07:11:22,572 [476] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '476'} gunicorn-registry stdout | 2020-07-23 07:11:22,590 [467] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '467'} gunicorn-registry stdout | 2020-07-23 07:11:22,594 [475] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '475'} gunicorn-registry stdout | 2020-07-23 07:11:22,599 [479] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '479'} gunicorn-registry stdout | 2020-07-23 07:11:22,604 [472] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '472'} gunicorn-registry stdout | 2020-07-23 07:11:22,609 [474] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '474'} gunicorn-registry stdout | 2020-07-23 07:11:22,623 [473] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '473'} gunicorn-registry stdout | 2020-07-23 07:11:22,626 [465] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '465'} gunicorn-registry stdout | 2020-07-23 07:11:22,638 [471] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '471'} gunicorn-registry stdout | 2020-07-23 07:11:22,642 [481] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '481'} builder stdout | 2020-07-23 07:11:23,464 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-verbs stdout | 2020-07-23 07:11:23,494 [127] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'verbs:application', 'pid': '127'} builder stdout | 2020-07-23 07:11:24,464 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:11:25,464 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 buildlogsarchiver stdout | 2020-07-23 07:11:26,396 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:11:26,397 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:11:56.395393+00:00 (in 29.998728 seconds) 2020-07-23 07:11:26,397 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:11:56 UTC)" (scheduled at 2020-07-23 07:11:26.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:11:26,399 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 11, 26, 397590), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:11:26,407 [109] [DEBUG] [__main__] No more builds to archive 2020-07-23 07:11:26,408 [109] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2020-07-23 07:11:26,408 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:11:56 UTC)" executed successfully builder stdout | 2020-07-23 07:11:26,465 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:11:27,465 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:11:28,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:11:28,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:11:38.291018+00:00 (in 9.999161 seconds) 2020-07-23 07:11:28,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:11:38 UTC)" (scheduled at 2020-07-23 07:11:28.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:11:28,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:11:28,304 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:11:28,304 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:11:28,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:11:38 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:11:28,382 [436] [DEBUG] [app] Starting request: urn:request:14108653-105f-4210-9a80-1f56a8008376 (/health/instance) gunicorn-web stdout | 2020-07-23 07:11:28,385 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:11:28,390 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:11:28,392 [463] [DEBUG] [app] Starting request: urn:request:77b0579f-9d71-48a5-aa0c-da08c5f3cae8 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:11:28,393 [463] [DEBUG] [app] Ending request: urn:request:77b0579f-9d71-48a5-aa0c-da08c5f3cae8 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:28 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-registry stdout | 2020-07-23 07:11:28,394 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:28 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:11:28,394 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:11:28,395 [436] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:11:28,402 [436] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:11:28,410 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:11:28,415 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:11:28,417 [436] [DEBUG] [app] Starting request: urn:request:0b5f931c-de78-4de6-92a7-29894cb4dac9 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:11:28,418 [436] [DEBUG] [app] Ending request: urn:request:0b5f931c-de78-4de6-92a7-29894cb4dac9 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:11:28,418 [436] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:28 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:28 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:11:28,419 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:11:28,423 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:28 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:11:28,424 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:11:28,428 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:11:28,429 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:28 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:11:28,433 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:11:28,435 [464] [DEBUG] [app] Starting request: urn:request:6342a632-b21c-482c-b4fd-0f5fff881674 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:11:28,436 [464] [DEBUG] [app] Ending request: urn:request:6342a632-b21c-482c-b4fd-0f5fff881674 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:28 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 162 0.002) gunicorn-web stdout | 2020-07-23 07:11:28,437 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:11:28,436 [464] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:28 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:11:28,439 [436] [DEBUG] [app] Ending request: urn:request:14108653-105f-4210-9a80-1f56a8008376 (/health/instance) 2020-07-23 07:11:28,439 [436] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:11:28,440 [436] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:11:28 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:11:28 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.059 49 0.059) builder stdout | 2020-07-23 07:11:28,465 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositorygcworker stdout | 2020-07-23 07:11:28,908 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:11:28,909 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:06.904189+00:00 (in 37.995057 seconds) 2020-07-23 07:11:28,909 [102] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:12:28 UTC)" (scheduled at 2020-07-23 07:11:28.907644+00:00) 2020-07-23 07:11:28,910 [102] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:11:28,910 [102] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:12:28 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:11:29,389 [431] [DEBUG] [app] Starting request: urn:request:4ee11a56-8554-4864-ac3d-2e9fbe87aca5 (/health/instance) gunicorn-web stdout | 2020-07-23 07:11:29,396 [431] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): localhost:8443 gunicorn-web stdout | 2020-07-23 07:11:29,404 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:11:29,406 [463] [DEBUG] [app] Starting request: urn:request:5f1477b3-c9da-488c-bf03-2ea719366994 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:11:29,408 [463] [DEBUG] [app] Ending request: urn:request:5f1477b3-c9da-488c-bf03-2ea719366994 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:11:29,408 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:29 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:11:29,409 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:29 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:11:29,412 [431] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:11:29,420 [431] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:11:29,429 [431] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:11:29,434 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:11:29,436 [419] [DEBUG] [app] Starting request: urn:request:69ffd859-4d4a-4da7-8a59-99545a86d0fb (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:11:29,437 [419] [DEBUG] [app] Ending request: urn:request:69ffd859-4d4a-4da7-8a59-99545a86d0fb (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:11:29,438 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:29 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:11:29,438 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:29 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:11:29,442 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:29 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:11:29,443 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:11:29,446 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:11:29,448 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:29 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:11:29,451 [431] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2020, 7, 23, 7, 11, 29, 449663), None, u'quay', u'quay', datetime.datetime(2020, 7, 23, 7, 11, 29, 449736), u'quay', None, datetime.datetime(2020, 7, 22, 7, 11, 29, 449772), datetime.datetime(2020, 7, 16, 7, 11, 29, 449803), None]) builder stdout | 2020-07-23 07:11:29,465 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:11:29,466 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:11:29,467 [464] [DEBUG] [app] Starting request: urn:request:0ce78f3f-704c-4330-8d11-ecd0660fd027 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:11:29,469 [464] [DEBUG] [app] Ending request: urn:request:0ce78f3f-704c-4330-8d11-ecd0660fd027 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:29 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:11:29,469 [464] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:29 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:11:29,470 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:11:29,473 [431] [DEBUG] [app] Ending request: urn:request:4ee11a56-8554-4864-ac3d-2e9fbe87aca5 (/health/instance) gunicorn-web stdout | 2020-07-23 07:11:29,473 [431] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:11:29,474 [431] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:11:29 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:11:29 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.092 49 0.092) notificationworker stdout | 2020-07-23 07:11:29,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:11:29,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:11:39.911177+00:00 (in 9.999186 seconds) 2020-07-23 07:11:29,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:11:39 UTC)" (scheduled at 2020-07-23 07:11:29.911177+00:00) 2020-07-23 07:11:29,912 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:11:29,914 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 11, 29, 912946), True, datetime.datetime(2020, 7, 23, 7, 11, 29, 912946), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:11:29,923 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:11:29,923 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:11:29,923 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:11:39 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:11:30,353 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:11:30,353 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:11:52.446816+00:00 (in 22.093569 seconds) 2020-07-23 07:11:30,353 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:12:00 UTC)" (scheduled at 2020-07-23 07:11:30.351857+00:00) 2020-07-23 07:11:30,354 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:11:30,356 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 11, 30, 354193), True, datetime.datetime(2020, 7, 23, 7, 11, 30, 354193), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:11:30,366 [101] [DEBUG] [workers.queueworker] No more work. security_notification_worker stdout | 2020-07-23 07:11:30,366 [101] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:11:30,366 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:12:00 UTC)" executed successfully builder stdout | 2020-07-23 07:11:30,466 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:11:31,056 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:11:31,069 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:11:31,069 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:11:31,466 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:11:32,466 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:11:33,466 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 securityworker stdout | 2020-07-23 07:11:33,477 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run securityworker stdout | 2020-07-23 07:11:33,477 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:03.476607+00:00 (in 29.999079 seconds) 2020-07-23 07:11:33,478 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:12:03 UTC)" (scheduled at 2020-07-23 07:11:33.476607+00:00) 2020-07-23 07:11:33,478 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:12:03 UTC)" executed successfully builder stdout | 2020-07-23 07:11:34,466 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gcworker stdout | 2020-07-23 07:11:34,829 [110] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'gcworker.py', 'pid': '110'} expiredappspecifictokenworker stdout | 2020-07-23 07:11:35,206 [126] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '126'} builder stdout | 2020-07-23 07:11:35,467 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 securityworker stdout | 2020-07-23 07:11:35,846 [128] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'securityworker.py', 'pid': '128'} teamsyncworker stdout | 2020-07-23 07:11:36,159 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'teamsyncworker.py', 'pid': '115'} builder stdout | 2020-07-23 07:11:36,464 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:11:36,464 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:11:35.467484 (running). builder stdout | 2020-07-23 07:11:36,467 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:11:37,467 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 exportactionlogsworker stdout | 2020-07-23 07:11:37,579 [99] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'exportactionlogsworker.py', 'pid': '99'} gunicorn-secscan stdout | 2020-07-23 07:11:37,911 [413] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '413'} gunicorn-secscan stdout | 2020-07-23 07:11:37,926 [412] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '412'} gunicorn-secscan stdout | 2020-07-23 07:11:37,939 [122] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '122'} gunicorn-secscan stdout | 2020-07-23 07:11:37,945 [411] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '411'} gunicorn-secscan stdout | 2020-07-23 07:11:37,958 [414] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '414'} queuecleanupworker stdout | 2020-07-23 07:11:37,992 [103] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'queuecleanupworker.py', 'pid': '103'} repositoryactioncounter stdout | 2020-07-23 07:11:38,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:11:38,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:11:48 UTC)" (scheduled at 2020-07-23 07:11:38.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:11:38,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:11:38,295 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:11:48.291018+00:00 (in 9.998858 seconds) repositoryactioncounter stdout | 2020-07-23 07:11:38,304 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:11:38,305 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:11:38,305 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:11:48 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:11:38,383 [419] [DEBUG] [app] Starting request: urn:request:b5a12d53-206b-4a47-8001-fb222b22aafd (/health/instance) gunicorn-web stdout | 2020-07-23 07:11:38,387 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:11:38,393 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:11:38,396 [463] [DEBUG] [app] Starting request: urn:request:c45404d8-840f-4abc-a166-cc98b547d615 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:11:38,397 [463] [DEBUG] [app] Ending request: urn:request:c45404d8-840f-4abc-a166-cc98b547d615 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:11:38,398 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:38 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:38 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.005 162 0.005) gunicorn-web stdout | 2020-07-23 07:11:38,399 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:11:38,400 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:11:38,407 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:11:38,414 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:11:38,419 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:11:38,421 [433] [DEBUG] [app] Starting request: urn:request:d133597e-da7e-4716-ab35-f2439baacdd3 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:11:38,422 [433] [DEBUG] [app] Ending request: urn:request:d133597e-da7e-4716-ab35-f2439baacdd3 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:11:38,423 [433] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:38 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:38 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:11:38,424 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:11:38,428 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:38 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:11:38,429 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:11:38,432 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:38 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:11:38,434 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:11:38,438 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:11:38,440 [464] [DEBUG] [app] Starting request: urn:request:29989a1f-1447-433e-b20c-c16200c55882 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:11:38,442 [464] [DEBUG] [app] Ending request: urn:request:29989a1f-1447-433e-b20c-c16200c55882 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:38 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-verbs stdout | 2020-07-23 07:11:38,442 [464] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:38 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:11:38,443 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:11:38,445 [419] [DEBUG] [app] Ending request: urn:request:b5a12d53-206b-4a47-8001-fb222b22aafd (/health/instance) 2020-07-23 07:11:38,445 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:11:38,446 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:11:38 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:11:38 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.064 49 0.064) builder stdout | 2020-07-23 07:11:38,467 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 globalpromstats stdout | 2020-07-23 07:11:38,851 [129] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'globalpromstats.py', 'pid': '129'} namespacegcworker stdout | 2020-07-23 07:11:39,074 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:11:39,075 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:06.910005+00:00 (in 27.835354 seconds) 2020-07-23 07:11:39,075 [134] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:12:39 UTC)" (scheduled at 2020-07-23 07:11:39.024941+00:00) 2020-07-23 07:11:39,075 [134] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:11:39,075 [134] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:12:39 UTC)" executed successfully buildlogsarchiver stdout | 2020-07-23 07:11:39,187 [109] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'buildlogsarchiver.py', 'pid': '109'} gunicorn-web stdout | 2020-07-23 07:11:39,384 [419] [DEBUG] [app] Starting request: urn:request:b0964b9b-faf5-408f-bd25-397dc7f6d7b2 (/health/instance) gunicorn-web stdout | 2020-07-23 07:11:39,388 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:11:39,390 [481] [DEBUG] [app] Starting request: urn:request:6f4e10d1-a68c-4527-897e-da57219f5cba (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:11:39,391 [481] [DEBUG] [app] Ending request: urn:request:6f4e10d1-a68c-4527-897e-da57219f5cba (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:11:39,392 [481] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:11:39,392 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:11:39,393 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:11:39,399 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:11:39,407 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:11:39,412 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:11:39,414 [419] [DEBUG] [app] Starting request: urn:request:5e0da315-c9d1-4b73-b549-a11d5218e31e (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:11:39,415 [419] [DEBUG] [app] Ending request: urn:request:5e0da315-c9d1-4b73-b549-a11d5218e31e (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:11:39,416 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:11:39,417 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:11:39,421 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:39 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:11:39,422 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:11:39,425 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:11:39,426 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:39 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:11:39,430 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:11:39,432 [468] [DEBUG] [app] Starting request: urn:request:eaa3ecec-73c8-44a9-bed8-58cb35db0b01 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:11:39,434 [468] [DEBUG] [app] Ending request: urn:request:eaa3ecec-73c8-44a9-bed8-58cb35db0b01 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:39 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:11:39,434 [468] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:39 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:11:39,435 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:11:39,437 [419] [DEBUG] [app] Ending request: urn:request:b0964b9b-faf5-408f-bd25-397dc7f6d7b2 (/health/instance) gunicorn-web stdout | 2020-07-23 07:11:39,437 [419] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:11:39,438 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:11:39 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:11:39 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.055 49 0.055) notificationworker stdout | 2020-07-23 07:11:39,445 [113] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'notificationworker.py', 'pid': '113'} builder stdout | 2020-07-23 07:11:39,468 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 chunkcleanupworker stdout | 2020-07-23 07:11:39,652 [124] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'chunkcleanupworker.py', 'pid': '124'} notificationworker stdout | 2020-07-23 07:11:39,914 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:11:39,915 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:11:49.911177+00:00 (in 9.996418 seconds) 2020-07-23 07:11:39,915 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:11:49 UTC)" (scheduled at 2020-07-23 07:11:39.911177+00:00) 2020-07-23 07:11:39,915 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:11:39,917 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 11, 39, 915800), True, datetime.datetime(2020, 7, 23, 7, 11, 39, 915800), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:11:39,927 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:11:39,927 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:11:39,927 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:11:49 UTC)" executed successfully gcworker stdout | 2020-07-23 07:11:40,005 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2020-07-23 07:11:40,006 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:10.004697+00:00 (in 29.998914 seconds) 2020-07-23 07:11:40,006 [110] [INFO] [apscheduler.executors.default] Running job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:12:10 UTC)" (scheduled at 2020-07-23 07:11:40.004697+00:00) gcworker stdout | 2020-07-23 07:11:40,008 [110] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1594278700006, 1209600, 500, 1, 0]) gcworker stdout | 2020-07-23 07:11:40,018 [110] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2020-07-23 07:11:40,018 [110] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:11:40,019 [110] [INFO] [apscheduler.executors.default] Job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:12:10 UTC)" executed successfully builder stdout | 2020-07-23 07:11:40,468 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:11:40,935 [130] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'builder.py', 'pid': '130'} builder stdout | 2020-07-23 07:11:41,071 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:11:41,084 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:11:41,085 [130] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:11:41,165 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositorygcworker.py', 'pid': '102'} namespacegcworker stdout | 2020-07-23 07:11:41,177 [134] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'namespacegcworker.py', 'pid': '134'} builder stdout | 2020-07-23 07:11:41,468 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 blobuploadcleanupworker stdout | 2020-07-23 07:11:41,634 [119] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'blobuploadcleanupworker.py', 'pid': '119'} builder stdout | 2020-07-23 07:11:42,468 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 security_notification_worker stdout | 2020-07-23 07:11:43,122 [101] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'security_notification_worker.py', 'pid': '101'} logrotateworker stdout | 2020-07-23 07:11:43,178 [118] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'logrotateworker.py', 'pid': '118'} storagereplication stdout | 2020-07-23 07:11:43,200 [133] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'storagereplication.py', 'pid': '133'} builder stdout | 2020-07-23 07:11:43,469 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:11:44,469 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:11:44,528 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositoryactioncounter.py', 'pid': '114'} servicekey stdout | 2020-07-23 07:11:45,170 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'servicekeyworker.py', 'pid': '98'} builder stdout | 2020-07-23 07:11:45,469 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:11:45,783 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '104'} gunicorn-web stdout | 2020-07-23 07:11:45,793 [435] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '435'} gunicorn-web stdout | 2020-07-23 07:11:45,806 [419] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '419'} gunicorn-web stdout | 2020-07-23 07:11:45,818 [438] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '438'} gunicorn-web stdout | 2020-07-23 07:11:45,824 [433] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '433'} gunicorn-web stdout | 2020-07-23 07:11:45,845 [431] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '431'} gunicorn-web stdout | 2020-07-23 07:11:45,856 [436] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '436'} gunicorn-web stdout | 2020-07-23 07:11:45,860 [420] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '420'} gunicorn-web stdout | 2020-07-23 07:11:45,864 [423] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '423'} builder stdout | 2020-07-23 07:11:46,466 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:11:46,467 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:11:45.469762 (running). builder stdout | 2020-07-23 07:11:46,469 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:11:47,469 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:11:48,294 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:11:48,295 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:11:58.291018+00:00 (in 9.995792 seconds) 2020-07-23 07:11:48,295 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:11:58 UTC)" (scheduled at 2020-07-23 07:11:48.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:11:48,297 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:11:48,307 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:11:48,307 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:11:48,307 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:11:58 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:11:48,383 [431] [DEBUG] [app] Starting request: urn:request:5660e20a-43ae-4c46-8512-c8fd4c82fb42 (/health/instance) gunicorn-web stdout | 2020-07-23 07:11:48,385 [431] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:11:48,391 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:11:48,393 [475] [DEBUG] [app] Starting request: urn:request:95b801c7-2341-45b6-b601-cfbd65502a20 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:11:48,394 [475] [DEBUG] [app] Ending request: urn:request:95b801c7-2341-45b6-b601-cfbd65502a20 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:11:48,395 [475] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:11:48,395 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:11:48,396 [431] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:11:48,402 [431] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:11:48,410 [431] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:11:48,415 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:11:48,417 [431] [DEBUG] [app] Starting request: urn:request:fbda0d25-c213-451e-ab83-3fca0cbd2f0c (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:11:48,418 [431] [DEBUG] [app] Ending request: urn:request:fbda0d25-c213-451e-ab83-3fca0cbd2f0c (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:11:48,419 [431] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:48 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:48 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:11:48,420 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:11:48,424 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:48 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:11:48,425 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:11:48,429 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:48 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:11:48,430 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:11:48,435 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:11:48,437 [468] [DEBUG] [app] Starting request: urn:request:cbe20e56-b839-49b3-aebc-0ace4d8ea47c (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:11:48,438 [468] [DEBUG] [app] Ending request: urn:request:cbe20e56-b839-49b3-aebc-0ace4d8ea47c (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:48 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:11:48,439 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:11:48,438 [468] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:48 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:11:48,441 [431] [DEBUG] [app] Ending request: urn:request:5660e20a-43ae-4c46-8512-c8fd4c82fb42 (/health/instance) 2020-07-23 07:11:48,441 [431] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:11:48,442 [431] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:11:48 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:11:48 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.061 49 0.061) builder stdout | 2020-07-23 07:11:48,470 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:11:49,385 [419] [DEBUG] [app] Starting request: urn:request:043e9f6e-2891-4167-a011-c6e2552f6334 (/health/instance) gunicorn-web stdout | 2020-07-23 07:11:49,387 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:11:49,392 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:11:49,394 [472] [DEBUG] [app] Starting request: urn:request:c8b5984f-772c-4068-8d03-5ff38bef25ad (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:11:49,396 [472] [DEBUG] [app] Ending request: urn:request:c8b5984f-772c-4068-8d03-5ff38bef25ad (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:11:49,396 [472] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:49 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:49 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:11:49,397 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:11:49,398 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:11:49,404 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:11:49,413 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:11:49,419 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:11:49,421 [419] [DEBUG] [app] Starting request: urn:request:a06b8925-2da3-4c55-9d2c-4fcf29378082 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:11:49,422 [419] [DEBUG] [app] Ending request: urn:request:a06b8925-2da3-4c55-9d2c-4fcf29378082 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:11:49,423 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:49 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:49 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:11:49,424 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:11:49,428 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:11:49,429 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:49 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:11:49,433 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:49 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:11:49,434 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:11:49,439 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:11:49,441 [464] [DEBUG] [app] Starting request: urn:request:1a035222-7c5c-4c00-821c-568fb78075e0 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:11:49,443 [464] [DEBUG] [app] Ending request: urn:request:1a035222-7c5c-4c00-821c-568fb78075e0 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:49 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:11:49,443 [464] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:49 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:11:49,444 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:11:49,446 [419] [DEBUG] [app] Ending request: urn:request:043e9f6e-2891-4167-a011-c6e2552f6334 (/health/instance) gunicorn-web stdout | 2020-07-23 07:11:49,447 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:11:49,448 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:11:49 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:11:49 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.064 49 0.064) builder stdout | 2020-07-23 07:11:49,470 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:11:49,912 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:11:49,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:11:59.911177+00:00 (in 9.998804 seconds) 2020-07-23 07:11:49,913 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:11:59 UTC)" (scheduled at 2020-07-23 07:11:49.911177+00:00) notificationworker stdout | 2020-07-23 07:11:49,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:11:49,916 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 11, 49, 913861), True, datetime.datetime(2020, 7, 23, 7, 11, 49, 913861), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:11:49,927 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:11:49,927 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:11:49,927 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:11:59 UTC)" executed successfully builder stdout | 2020-07-23 07:11:50,470 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:11:50,714 [130] [DEBUG] [buildman.server] Writing metrics builder stdout | 2020-07-23 07:11:50,727 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds builder stdout | 2020-07-23 07:11:51,086 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:11:51,097 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:11:51,097 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:11:51,470 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 security_notification_worker stdout | 2020-07-23 07:11:52,447 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:11:52,448 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:00.351857+00:00 (in 7.904022 seconds) 2020-07-23 07:11:52,448 [101] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:12:52 UTC)" (scheduled at 2020-07-23 07:11:52.446816+00:00) 2020-07-23 07:11:52,448 [101] [DEBUG] [workers.queueworker] Running watchdog. security_notification_worker stdout | 2020-07-23 07:11:52,448 [101] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:12:52 UTC)" executed successfully builder stdout | 2020-07-23 07:11:52,471 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-registry stdout | 2020-07-23 07:11:52,494 [469] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '469'} gunicorn-registry stdout | 2020-07-23 07:11:52,518 [100] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '100'} gunicorn-registry stdout | 2020-07-23 07:11:52,537 [463] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '463'} gunicorn-registry stdout | 2020-07-23 07:11:52,540 [477] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '477'} gunicorn-registry stdout | 2020-07-23 07:11:52,559 [478] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '478'} gunicorn-registry stdout | 2020-07-23 07:11:52,569 [470] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '470'} gunicorn-registry stdout | 2020-07-23 07:11:52,572 [480] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '480'} gunicorn-registry stdout | 2020-07-23 07:11:52,584 [476] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '476'} gunicorn-registry stdout | 2020-07-23 07:11:52,606 [467] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '467'} gunicorn-registry stdout | 2020-07-23 07:11:52,616 [475] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '475'} gunicorn-registry stdout | 2020-07-23 07:11:52,621 [479] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '479'} gunicorn-registry stdout | 2020-07-23 07:11:52,624 [472] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '472'} gunicorn-registry stdout | 2020-07-23 07:11:52,628 [474] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '474'} gunicorn-registry stdout | 2020-07-23 07:11:52,636 [473] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '473'} gunicorn-registry stdout | 2020-07-23 07:11:52,641 [465] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '465'} gunicorn-registry stdout | 2020-07-23 07:11:52,652 [471] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '471'} gunicorn-registry stdout | 2020-07-23 07:11:52,658 [481] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '481'} builder stdout | 2020-07-23 07:11:53,471 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-verbs stdout | 2020-07-23 07:11:53,605 [127] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'verbs:application', 'pid': '127'} builder stdout | 2020-07-23 07:11:54,471 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:11:55,471 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 buildlogsarchiver stdout | 2020-07-23 07:11:56,396 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:11:56,396 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:26.395393+00:00 (in 29.999071 seconds) 2020-07-23 07:11:56,397 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:12:26 UTC)" (scheduled at 2020-07-23 07:11:56.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:11:56,398 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 11, 56, 397138), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:11:56,407 [109] [DEBUG] [__main__] No more builds to archive 2020-07-23 07:11:56,407 [109] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2020-07-23 07:11:56,407 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:12:26 UTC)" executed successfully builder stdout | 2020-07-23 07:11:56,469 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 2020-07-23 07:11:56,469 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:11:55.472108 (running). builder stdout | 2020-07-23 07:11:56,472 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:11:57,472 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:11:58,292 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:11:58,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:08.291018+00:00 (in 9.998755 seconds) 2020-07-23 07:11:58,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:12:08 UTC)" (scheduled at 2020-07-23 07:11:58.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:11:58,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:11:58,305 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:11:58,305 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:11:58,306 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:12:08 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:11:58,383 [419] [DEBUG] [app] Starting request: urn:request:58d719b8-ed11-4cc4-8ddc-665b6fc35f2a (/health/instance) gunicorn-web stdout | 2020-07-23 07:11:58,385 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:11:58,390 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:11:58,392 [463] [DEBUG] [app] Starting request: urn:request:a9c47bd5-1a2f-4388-adf7-9ac0673dcad1 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:11:58,393 [463] [DEBUG] [app] Ending request: urn:request:a9c47bd5-1a2f-4388-adf7-9ac0673dcad1 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:11:58,394 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:11:58,394 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:11:58,396 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:11:58,401 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:11:58,409 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:11:58,414 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:11:58,416 [438] [DEBUG] [app] Starting request: urn:request:ba5d662a-18ac-4808-82f1-9e5207b638e9 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:11:58,417 [438] [DEBUG] [app] Ending request: urn:request:ba5d662a-18ac-4808-82f1-9e5207b638e9 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:11:58,417 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:58 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:11:58,418 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:58 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:11:58,422 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:11:58,423 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:58 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:11:58,426 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:11:58,427 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:58 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:11:58,432 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:11:58,434 [464] [DEBUG] [app] Starting request: urn:request:74cda584-8f78-4e85-8693-482e5b7fe403 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:11:58,435 [464] [DEBUG] [app] Ending request: urn:request:74cda584-8f78-4e85-8693-482e5b7fe403 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:58 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:11:58,436 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:11:58,436 [464] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:58 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:11:58,438 [419] [DEBUG] [app] Ending request: urn:request:58d719b8-ed11-4cc4-8ddc-665b6fc35f2a (/health/instance) 2020-07-23 07:11:58,439 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:11:58,440 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:11:58 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:11:58 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.059 49 0.059) builder stdout | 2020-07-23 07:11:58,472 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:11:59,384 [436] [DEBUG] [app] Starting request: urn:request:50319219-6f43-4e2b-b944-693ad2b33f93 (/health/instance) gunicorn-web stdout | 2020-07-23 07:11:59,387 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:11:59,392 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:11:59,394 [463] [DEBUG] [app] Starting request: urn:request:4fe1049f-6a83-43c8-b6e3-1359f0b3c8bd (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:11:59,395 [463] [DEBUG] [app] Ending request: urn:request:4fe1049f-6a83-43c8-b6e3-1359f0b3c8bd (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:11:59,396 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:59 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:59 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:11:59,397 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:11:59,398 [436] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:11:59,403 [436] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:11:59,411 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:11:59,416 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:11:59,418 [436] [DEBUG] [app] Starting request: urn:request:d202f0a9-6464-4ac6-a178-391270f94cff (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:11:59,419 [436] [DEBUG] [app] Ending request: urn:request:d202f0a9-6464-4ac6-a178-391270f94cff (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:11:59,420 [436] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:59 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:11:59,420 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:59 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 159 0.002) gunicorn-web stdout | 2020-07-23 07:11:59,424 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:59 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:11:59,425 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:11:59,428 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:59 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:11:59,429 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:11:59,433 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:11:59,435 [464] [DEBUG] [app] Starting request: urn:request:343bbd57-919d-4641-89a0-a18511ca2009 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:11:59,436 [464] [DEBUG] [app] Ending request: urn:request:343bbd57-919d-4641-89a0-a18511ca2009 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:11:59 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:11:59,437 [464] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:11:59 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:11:59,437 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:11:59,439 [436] [DEBUG] [app] Ending request: urn:request:50319219-6f43-4e2b-b944-693ad2b33f93 (/health/instance) 2020-07-23 07:11:59,439 [436] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:11:59 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.057 49 0.057) gunicorn-web stdout | 2020-07-23 07:11:59,440 [436] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:11:59 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" builder stdout | 2020-07-23 07:11:59,472 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:11:59,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:11:59,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:09.911177+00:00 (in 9.999105 seconds) 2020-07-23 07:11:59,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:12:09 UTC)" (scheduled at 2020-07-23 07:11:59.911177+00:00) 2020-07-23 07:11:59,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:11:59,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 11, 59, 913096), True, datetime.datetime(2020, 7, 23, 7, 11, 59, 913096), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:11:59,924 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:11:59,924 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:11:59,924 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:12:09 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:12:00,352 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:12:00,353 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:30.351857+00:00 (in 29.998912 seconds) 2020-07-23 07:12:00,353 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:12:30 UTC)" (scheduled at 2020-07-23 07:12:00.351857+00:00) 2020-07-23 07:12:00,353 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:12:00,356 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 12, 0, 353862), True, datetime.datetime(2020, 7, 23, 7, 12, 0, 353862), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:12:00,364 [101] [DEBUG] [workers.queueworker] No more work. security_notification_worker stdout | 2020-07-23 07:12:00,365 [101] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:12:00,365 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:12:30 UTC)" executed successfully builder stdout | 2020-07-23 07:12:00,472 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:12:01,104 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:12:01,117 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:12:01,118 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:12:01,473 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:12:02,473 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:12:03,473 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 securityworker stdout | 2020-07-23 07:12:03,477 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run securityworker stdout | 2020-07-23 07:12:03,478 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:33.476607+00:00 (in 29.998943 seconds) 2020-07-23 07:12:03,478 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:12:33 UTC)" (scheduled at 2020-07-23 07:12:03.476607+00:00) securityworker stdout | 2020-07-23 07:12:03,478 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:12:33 UTC)" executed successfully exportactionlogsworker stdout | 2020-07-23 07:12:03,972 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:12:03,973 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:08.212267+00:00 (in 4.239487 seconds) 2020-07-23 07:12:03,973 [99] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:13:03 UTC)" (scheduled at 2020-07-23 07:12:03.971686+00:00) 2020-07-23 07:12:03,973 [99] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2020-07-23 07:12:03,976 [99] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 12, 3, 973680), True, datetime.datetime(2020, 7, 23, 7, 12, 3, 973680), 0, u'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2020-07-23 07:12:03,986 [99] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2020-07-23 07:12:03,986 [99] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:12:03,986 [99] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:13:03 UTC)" executed successfully builder stdout | 2020-07-23 07:12:04,474 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gcworker stdout | 2020-07-23 07:12:04,850 [110] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'gcworker.py', 'pid': '110'} expiredappspecifictokenworker stdout | 2020-07-23 07:12:05,246 [126] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '126'} builder stdout | 2020-07-23 07:12:05,474 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 securityworker stdout | 2020-07-23 07:12:05,884 [128] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'securityworker.py', 'pid': '128'} teamsyncworker stdout | 2020-07-23 07:12:06,197 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'teamsyncworker.py', 'pid': '115'} builder stdout | 2020-07-23 07:12:06,470 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:12:06,471 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:12:05.474440 (running). builder stdout | 2020-07-23 07:12:06,474 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositorygcworker stdout | 2020-07-23 07:12:06,905 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:12:06,905 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:21.739118+00:00 (in 14.833922 seconds) 2020-07-23 07:12:06,905 [102] [INFO] [apscheduler.executors.default] Running job "update_queue_metrics (trigger: interval[0:05:00], next run at: 2020-07-23 07:17:06 UTC)" (scheduled at 2020-07-23 07:12:06.904189+00:00) repositorygcworker stdout | 2020-07-23 07:12:06,907 [102] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2020, 7, 23, 7, 12, 6, 906272), u'repositorygc/%']) namespacegcworker stdout | 2020-07-23 07:12:06,910 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:12:06,911 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:23.024302+00:00 (in 16.113416 seconds) 2020-07-23 07:12:06,911 [134] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:13:06 UTC)" (scheduled at 2020-07-23 07:12:06.910005+00:00) namespacegcworker stdout | 2020-07-23 07:12:06,911 [134] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2020-07-23 07:12:06,914 [134] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 12, 6, 911762), True, datetime.datetime(2020, 7, 23, 7, 12, 6, 911762), 0, u'namespacegc/%', 50, 1, 0]) repositorygcworker stdout | 2020-07-23 07:12:06,916 [102] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2020, 7, 23, 7, 12, 6, 906272), True, datetime.datetime(2020, 7, 23, 7, 12, 6, 906272), 0, u'repositorygc/%']) 2020-07-23 07:12:06,920 [102] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2020, 7, 23, 7, 12, 6, 906272), True, datetime.datetime(2020, 7, 23, 7, 12, 6, 906272), 0, u'repositorygc/%', False, datetime.datetime(2020, 7, 23, 7, 12, 6, 906272), u'repositorygc/%']) 2020-07-23 07:12:06,922 [102] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:12:06,923 [102] [INFO] [apscheduler.executors.default] Job "update_queue_metrics (trigger: interval[0:05:00], next run at: 2020-07-23 07:17:06 UTC)" executed successfully namespacegcworker stdout | 2020-07-23 07:12:06,924 [134] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:12:06,924 [134] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:12:06,924 [134] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:13:06 UTC)" executed successfully builder stdout | 2020-07-23 07:12:07,474 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 exportactionlogsworker stdout | 2020-07-23 07:12:07,618 [99] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'exportactionlogsworker.py', 'pid': '99'} gunicorn-secscan stdout | 2020-07-23 07:12:07,922 [413] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '413'} gunicorn-secscan stdout | 2020-07-23 07:12:07,937 [412] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '412'} gunicorn-secscan stdout | 2020-07-23 07:12:07,954 [122] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '122'} gunicorn-secscan stdout | 2020-07-23 07:12:07,959 [411] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '411'} gunicorn-secscan stdout | 2020-07-23 07:12:07,969 [414] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '414'} queuecleanupworker stdout | 2020-07-23 07:12:08,031 [103] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'queuecleanupworker.py', 'pid': '103'} exportactionlogsworker stdout | 2020-07-23 07:12:08,212 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:12:08,213 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:13:03.971686+00:00 (in 55.758501 seconds) 2020-07-23 07:12:08,213 [99] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:13:08 UTC)" (scheduled at 2020-07-23 07:12:08.212267+00:00) 2020-07-23 07:12:08,214 [99] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2020-07-23 07:12:08,214 [99] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:13:08 UTC)" executed successfully repositoryactioncounter stdout | 2020-07-23 07:12:08,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:12:08,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:18.291018+00:00 (in 9.999093 seconds) 2020-07-23 07:12:08,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:12:18 UTC)" (scheduled at 2020-07-23 07:12:08.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:12:08,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:12:08,303 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:12:08,303 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:12:08,303 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:12:18 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:12:08,383 [438] [DEBUG] [app] Starting request: urn:request:dd329493-6e3f-47ad-ad84-cf9462fa8073 (/health/instance) gunicorn-web stdout | 2020-07-23 07:12:08,386 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:12:08,391 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:12:08,393 [475] [DEBUG] [app] Starting request: urn:request:2ce0c488-2aa2-4b2e-bb14-3d06ad2f2554 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:12:08,394 [475] [DEBUG] [app] Ending request: urn:request:2ce0c488-2aa2-4b2e-bb14-3d06ad2f2554 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:12:08,395 [475] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:08 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:08 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 162 0.002) gunicorn-web stdout | 2020-07-23 07:12:08,395 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:12:08,396 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:12:08,403 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:12:08,411 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:12:08,417 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:12:08,419 [435] [DEBUG] [app] Starting request: urn:request:57b89467-dd87-41e6-9286-be8055c64947 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:12:08,420 [435] [DEBUG] [app] Ending request: urn:request:57b89467-dd87-41e6-9286-be8055c64947 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:12:08,421 [435] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:08 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:12:08,422 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:08 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:12:08,426 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:08 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:12:08,427 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:12:08,430 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:08 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:12:08,431 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:12:08,435 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:12:08,437 [464] [DEBUG] [app] Starting request: urn:request:e8208271-9d3d-41a1-aa93-a4f11bb25118 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:12:08,438 [464] [DEBUG] [app] Ending request: urn:request:e8208271-9d3d-41a1-aa93-a4f11bb25118 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:08 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:12:08,439 [464] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:08 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:12:08,439 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:12:08,441 [438] [DEBUG] [app] Ending request: urn:request:dd329493-6e3f-47ad-ad84-cf9462fa8073 (/health/instance) gunicorn-web stdout | 2020-07-23 07:12:08,441 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:12:08,442 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:12:08 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:12:08 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.061 49 0.061) builder stdout | 2020-07-23 07:12:08,475 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 globalpromstats stdout | 2020-07-23 07:12:08,891 [129] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'globalpromstats.py', 'pid': '129'} buildlogsarchiver stdout | 2020-07-23 07:12:09,228 [109] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'buildlogsarchiver.py', 'pid': '109'} gunicorn-web stdout | 2020-07-23 07:12:09,384 [419] [DEBUG] [app] Starting request: urn:request:6b9d419e-eca0-4472-a8da-83c19057e4fc (/health/instance) gunicorn-web stdout | 2020-07-23 07:12:09,387 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:12:09,392 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:12:09,394 [481] [DEBUG] [app] Starting request: urn:request:c118ae08-d5bd-49a5-9b95-45cd54c2fc72 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:12:09,395 [481] [DEBUG] [app] Ending request: urn:request:c118ae08-d5bd-49a5-9b95-45cd54c2fc72 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:12:09,396 [481] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:12:09,396 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:12:09,397 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:12:09,403 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:12:09,410 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:12:09,415 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:12:09,416 [419] [DEBUG] [app] Starting request: urn:request:1b35fdf3-06de-400f-8eb8-a045be2ec7e5 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:12:09,417 [419] [DEBUG] [app] Ending request: urn:request:1b35fdf3-06de-400f-8eb8-a045be2ec7e5 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:12:09,418 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:12:09,418 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:12:09,422 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:09 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:12:09,423 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:12:09,426 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:09 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:12:09,427 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:12:09,431 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:12:09,433 [462] [DEBUG] [app] Starting request: urn:request:cbbe11f5-64a6-4daa-afe9-9f4691e9fc40 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:12:09,433 [462] [DEBUG] [app] Ending request: urn:request:cbbe11f5-64a6-4daa-afe9-9f4691e9fc40 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:09 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:12:09,434 [462] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:09 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:12:09,434 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:12:09,436 [419] [DEBUG] [app] Ending request: urn:request:6b9d419e-eca0-4472-a8da-83c19057e4fc (/health/instance) gunicorn-web stdout | 2020-07-23 07:12:09,437 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:12:09,437 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:12:09 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:12:09 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.056 49 0.056) builder stdout | 2020-07-23 07:12:09,475 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:12:09,479 [113] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'notificationworker.py', 'pid': '113'} chunkcleanupworker stdout | 2020-07-23 07:12:09,693 [124] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'chunkcleanupworker.py', 'pid': '124'} notificationworker stdout | 2020-07-23 07:12:09,912 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:12:09,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:12:19 UTC)" (scheduled at 2020-07-23 07:12:09.911177+00:00) 2020-07-23 07:12:09,913 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:11.998621+00:00 (in 2.086272 seconds) 2020-07-23 07:12:09,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:12:09,916 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 12, 9, 913599), True, datetime.datetime(2020, 7, 23, 7, 12, 9, 913599), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:12:09,925 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:12:09,925 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:12:09,925 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:12:19 UTC)" executed successfully gcworker stdout | 2020-07-23 07:12:10,005 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2020-07-23 07:12:10,005 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:40.004697+00:00 (in 29.999171 seconds) 2020-07-23 07:12:10,006 [110] [INFO] [apscheduler.executors.default] Running job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:12:40 UTC)" (scheduled at 2020-07-23 07:12:10.004697+00:00) gcworker stdout | 2020-07-23 07:12:10,008 [110] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1594278730006, 1209600, 500, 1, 0]) gcworker stdout | 2020-07-23 07:12:10,017 [110] [DEBUG] [__main__] No repository with garbage found 2020-07-23 07:12:10,017 [110] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2020-07-23 07:12:10,017 [110] [INFO] [apscheduler.executors.default] Job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:12:40 UTC)" executed successfully builder stdout | 2020-07-23 07:12:10,475 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:12:10,975 [130] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'builder.py', 'pid': '130'} builder stdout | 2020-07-23 07:12:11,119 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:12:11,132 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:12:11,133 [130] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:12:11,207 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositorygcworker.py', 'pid': '102'} namespacegcworker stdout | 2020-07-23 07:12:11,217 [134] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'namespacegcworker.py', 'pid': '134'} builder stdout | 2020-07-23 07:12:11,475 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 blobuploadcleanupworker stdout | 2020-07-23 07:12:11,671 [119] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'blobuploadcleanupworker.py', 'pid': '119'} notificationworker stdout | 2020-07-23 07:12:12,001 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:12:12,002 [113] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:13:11 UTC)" (scheduled at 2020-07-23 07:12:11.998621+00:00) 2020-07-23 07:12:12,002 [113] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:12:12,003 [113] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:13:11 UTC)" executed successfully notificationworker stdout | 2020-07-23 07:12:12,003 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:19.911177+00:00 (in 7.908976 seconds) builder stdout | 2020-07-23 07:12:12,475 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 security_notification_worker stdout | 2020-07-23 07:12:13,162 [101] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'security_notification_worker.py', 'pid': '101'} logrotateworker stdout | 2020-07-23 07:12:13,210 [118] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'logrotateworker.py', 'pid': '118'} storagereplication stdout | 2020-07-23 07:12:13,241 [133] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'storagereplication.py', 'pid': '133'} builder stdout | 2020-07-23 07:12:13,476 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:12:14,476 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:12:14,566 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositoryactioncounter.py', 'pid': '114'} servicekey stdout | 2020-07-23 07:12:15,208 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'servicekeyworker.py', 'pid': '98'} builder stdout | 2020-07-23 07:12:15,476 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:12:15,794 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '104'} gunicorn-web stdout | 2020-07-23 07:12:15,805 [435] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '435'} gunicorn-web stdout | 2020-07-23 07:12:15,816 [419] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '419'} gunicorn-web stdout | 2020-07-23 07:12:15,827 [438] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '438'} gunicorn-web stdout | 2020-07-23 07:12:15,834 [433] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '433'} gunicorn-web stdout | 2020-07-23 07:12:15,855 [431] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '431'} gunicorn-web stdout | 2020-07-23 07:12:15,867 [436] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '436'} gunicorn-web stdout | 2020-07-23 07:12:15,877 [420] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '420'} gunicorn-web stdout | 2020-07-23 07:12:15,881 [423] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '423'} builder stdout | 2020-07-23 07:12:16,472 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 2020-07-23 07:12:16,473 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:12:15.476773 (running). builder stdout | 2020-07-23 07:12:16,476 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:12:17,477 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:12:18,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:12:18,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:28.291018+00:00 (in 9.999085 seconds) 2020-07-23 07:12:18,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:12:28 UTC)" (scheduled at 2020-07-23 07:12:18.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:12:18,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:12:18,303 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:12:18,303 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:12:18,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:12:28 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:12:18,382 [419] [DEBUG] [app] Starting request: urn:request:a39ab6ba-db33-4154-95e5-5ce4de0b05dc (/health/instance) gunicorn-web stdout | 2020-07-23 07:12:18,385 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:12:18,389 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:12:18,391 [475] [DEBUG] [app] Starting request: urn:request:8f882232-b6a2-484d-a386-47e9c2e6d5fb (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:12:18,392 [475] [DEBUG] [app] Ending request: urn:request:8f882232-b6a2-484d-a386-47e9c2e6d5fb (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:18 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-registry stdout | 2020-07-23 07:12:18,393 [475] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:18 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:12:18,393 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:12:18,394 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:12:18,400 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:12:18,409 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:12:18,414 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:12:18,416 [435] [DEBUG] [app] Starting request: urn:request:193a531e-0300-4139-bb3f-d0b19d7892de (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:12:18,417 [435] [DEBUG] [app] Ending request: urn:request:193a531e-0300-4139-bb3f-d0b19d7892de (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:18 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:12:18,418 [435] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:18 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:12:18,418 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:12:18,422 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:18 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:12:18,423 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:12:18,427 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:12:18,428 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:18 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:12:18,432 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:12:18,434 [460] [DEBUG] [app] Starting request: urn:request:8b747b52-0857-4f0c-9743-a8f5b44d535d (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:12:18,435 [460] [DEBUG] [app] Ending request: urn:request:8b747b52-0857-4f0c-9743-a8f5b44d535d (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:12:18,436 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:18 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 162 0.002) gunicorn-verbs stdout | 2020-07-23 07:12:18,436 [460] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:18 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:12:18,438 [419] [DEBUG] [app] Ending request: urn:request:a39ab6ba-db33-4154-95e5-5ce4de0b05dc (/health/instance) gunicorn-web stdout | 2020-07-23 07:12:18,438 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:12:18,439 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:12:18 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:12:18 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.058 49 0.058) builder stdout | 2020-07-23 07:12:18,477 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:12:19,384 [419] [DEBUG] [app] Starting request: urn:request:bc09c923-c000-4640-b115-be97d3ff8591 (/health/instance) gunicorn-web stdout | 2020-07-23 07:12:19,388 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:12:19,391 [463] [DEBUG] [app] Starting request: urn:request:c46213a1-72e8-4bcc-940e-1d5a5da3a57f (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:12:19,392 [463] [DEBUG] [app] Ending request: urn:request:c46213a1-72e8-4bcc-940e-1d5a5da3a57f (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:12:19,392 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:19 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:19 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:12:19,393 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:12:19,394 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:12:19,399 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:12:19,407 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:12:19,412 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:12:19,414 [419] [DEBUG] [app] Starting request: urn:request:ff941dcb-b737-41a2-959b-91e0194a3ffe (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:12:19,415 [419] [DEBUG] [app] Ending request: urn:request:ff941dcb-b737-41a2-959b-91e0194a3ffe (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:12:19,415 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:19 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:19 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:12:19,416 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:12:19,420 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:19 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:12:19,420 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:12:19,424 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:19 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:12:19,426 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:12:19,430 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:12:19,432 [460] [DEBUG] [app] Starting request: urn:request:15401c95-8ab5-436b-ab5a-586b10e7c258 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:12:19,433 [460] [DEBUG] [app] Ending request: urn:request:15401c95-8ab5-436b-ab5a-586b10e7c258 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:12:19,434 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:19 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:12:19,434 [460] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:19 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:12:19,436 [419] [DEBUG] [app] Ending request: urn:request:bc09c923-c000-4640-b115-be97d3ff8591 (/health/instance) 2020-07-23 07:12:19,436 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:12:19,437 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:12:19 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:12:19 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.054 49 0.054) builder stdout | 2020-07-23 07:12:19,477 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:12:19,912 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:12:19,913 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:29.911177+00:00 (in 9.998240 seconds) notificationworker stdout | 2020-07-23 07:12:19,914 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:12:29 UTC)" (scheduled at 2020-07-23 07:12:19.911177+00:00) 2020-07-23 07:12:19,915 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:12:19,917 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 12, 19, 915211), True, datetime.datetime(2020, 7, 23, 7, 12, 19, 915211), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:12:19,928 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:12:19,928 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:12:19,928 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:12:29 UTC)" executed successfully builder stdout | 2020-07-23 07:12:20,477 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:12:20,729 [130] [DEBUG] [buildman.server] Writing metrics builder stdout | 2020-07-23 07:12:20,742 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds builder stdout | 2020-07-23 07:12:21,134 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:12:21,140 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:12:21,140 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:12:21,477 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositorygcworker stdout | 2020-07-23 07:12:21,740 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:12:21,740 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:28.907644+00:00 (in 7.167246 seconds) 2020-07-23 07:12:21,741 [102] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:13:21 UTC)" (scheduled at 2020-07-23 07:12:21.739118+00:00) 2020-07-23 07:12:21,741 [102] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2020-07-23 07:12:21,743 [102] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 12, 21, 741335), True, datetime.datetime(2020, 7, 23, 7, 12, 21, 741335), 0, u'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2020-07-23 07:12:21,752 [102] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:12:21,752 [102] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:12:21,752 [102] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:13:21 UTC)" executed successfully builder stdout | 2020-07-23 07:12:22,478 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-registry stdout | 2020-07-23 07:12:22,506 [469] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '469'} gunicorn-registry stdout | 2020-07-23 07:12:22,529 [100] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '100'} gunicorn-registry stdout | 2020-07-23 07:12:22,552 [463] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '463'} gunicorn-registry stdout | 2020-07-23 07:12:22,555 [477] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '477'} gunicorn-registry stdout | 2020-07-23 07:12:22,569 [478] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '478'} gunicorn-registry stdout | 2020-07-23 07:12:22,582 [470] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '470'} gunicorn-registry stdout | 2020-07-23 07:12:22,586 [480] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '480'} gunicorn-registry stdout | 2020-07-23 07:12:22,595 [476] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '476'} gunicorn-registry stdout | 2020-07-23 07:12:22,620 [467] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '467'} gunicorn-registry stdout | 2020-07-23 07:12:22,634 [475] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '475'} gunicorn-registry stdout | 2020-07-23 07:12:22,635 [479] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '479'} gunicorn-registry stdout | 2020-07-23 07:12:22,638 [472] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '472'} gunicorn-registry stdout | 2020-07-23 07:12:22,641 [474] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '474'} gunicorn-registry stdout | 2020-07-23 07:12:22,649 [473] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '473'} gunicorn-registry stdout | 2020-07-23 07:12:22,655 [465] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '465'} gunicorn-registry stdout | 2020-07-23 07:12:22,665 [471] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '471'} gunicorn-registry stdout | 2020-07-23 07:12:22,668 [481] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '481'} namespacegcworker stdout | 2020-07-23 07:12:23,024 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:12:23,025 [134] [INFO] [apscheduler.executors.default] Running job "update_queue_metrics (trigger: interval[0:05:00], next run at: 2020-07-23 07:17:23 UTC)" (scheduled at 2020-07-23 07:12:23.024302+00:00) namespacegcworker stdout | 2020-07-23 07:12:23,027 [134] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2020, 7, 23, 7, 12, 23, 25906), u'namespacegc/%']) 2020-07-23 07:12:23,027 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:39.024941+00:00 (in 15.999745 seconds) namespacegcworker stdout | 2020-07-23 07:12:23,035 [134] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2020, 7, 23, 7, 12, 23, 25906), True, datetime.datetime(2020, 7, 23, 7, 12, 23, 25906), 0, u'namespacegc/%']) namespacegcworker stdout | 2020-07-23 07:12:23,038 [134] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2020, 7, 23, 7, 12, 23, 25906), True, datetime.datetime(2020, 7, 23, 7, 12, 23, 25906), 0, u'namespacegc/%', False, datetime.datetime(2020, 7, 23, 7, 12, 23, 25906), u'namespacegc/%']) namespacegcworker stdout | 2020-07-23 07:12:23,040 [134] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2020-07-23 07:12:23,040 [134] [INFO] [apscheduler.executors.default] Job "update_queue_metrics (trigger: interval[0:05:00], next run at: 2020-07-23 07:17:23 UTC)" executed successfully builder stdout | 2020-07-23 07:12:23,478 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-verbs stdout | 2020-07-23 07:12:23,713 [127] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'verbs:application', 'pid': '127'} builder stdout | 2020-07-23 07:12:24,478 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:12:25,478 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 buildlogsarchiver stdout | 2020-07-23 07:12:26,396 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:12:26,396 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:56.395393+00:00 (in 29.999031 seconds) 2020-07-23 07:12:26,397 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:12:56 UTC)" (scheduled at 2020-07-23 07:12:26.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:12:26,398 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 12, 26, 397163), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:12:26,407 [109] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2020-07-23 07:12:26,407 [109] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:12:26,408 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:12:56 UTC)" executed successfully builder stdout | 2020-07-23 07:12:26,474 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:12:26,475 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:12:25.479079 (running). builder stdout | 2020-07-23 07:12:26,479 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:12:27,479 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:12:28,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:12:28,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:38.291018+00:00 (in 9.998944 seconds) repositoryactioncounter stdout | 2020-07-23 07:12:28,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:12:38 UTC)" (scheduled at 2020-07-23 07:12:28.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:12:28,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:12:28,305 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:12:28,305 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:12:28,305 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:12:38 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:12:28,382 [438] [DEBUG] [app] Starting request: urn:request:66d28821-04e3-4e4b-a3ae-94cf655e1863 (/health/instance) gunicorn-web stdout | 2020-07-23 07:12:28,384 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:12:28,390 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:12:28,392 [463] [DEBUG] [app] Starting request: urn:request:b3110989-bafe-4b63-8f80-4efc927159b7 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:12:28,393 [463] [DEBUG] [app] Ending request: urn:request:b3110989-bafe-4b63-8f80-4efc927159b7 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:12:28,394 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:28 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:28 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:12:28,394 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:12:28,395 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:12:28,400 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:12:28,407 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:12:28,412 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:12:28,414 [438] [DEBUG] [app] Starting request: urn:request:a9f92f6b-5e01-4d8e-98ae-a5e8d8641fe1 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:12:28,415 [438] [DEBUG] [app] Ending request: urn:request:a9f92f6b-5e01-4d8e-98ae-a5e8d8641fe1 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:12:28,416 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:28 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:28 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 159 0.002) gunicorn-web stdout | 2020-07-23 07:12:28,416 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:12:28,421 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:28 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:12:28,421 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:12:28,425 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:28 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:12:28,426 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:12:28,430 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:12:28,432 [460] [DEBUG] [app] Starting request: urn:request:8f531ab2-5c81-48bd-be65-892bd609e227 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:28 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:12:28,433 [460] [DEBUG] [app] Ending request: urn:request:8f531ab2-5c81-48bd-be65-892bd609e227 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:12:28,433 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:12:28,433 [460] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:28 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:12:28,436 [438] [DEBUG] [app] Ending request: urn:request:66d28821-04e3-4e4b-a3ae-94cf655e1863 (/health/instance) 2020-07-23 07:12:28,436 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:12:28,437 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:12:28 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:12:28 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.056 49 0.056) builder stdout | 2020-07-23 07:12:28,479 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositorygcworker stdout | 2020-07-23 07:12:28,908 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:12:28,909 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:13:21.739118+00:00 (in 52.830255 seconds) 2020-07-23 07:12:28,909 [102] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:13:28 UTC)" (scheduled at 2020-07-23 07:12:28.907644+00:00) 2020-07-23 07:12:28,909 [102] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:12:28,909 [102] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:13:28 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:12:29,384 [436] [DEBUG] [app] Starting request: urn:request:0b7e9cd0-964f-4384-9016-9390179b74ca (/health/instance) gunicorn-web stdout | 2020-07-23 07:12:29,387 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:12:29,393 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:12:29,395 [465] [DEBUG] [app] Starting request: urn:request:28e1581c-9491-4e17-9661-962dd58da036 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:12:29,396 [465] [DEBUG] [app] Ending request: urn:request:28e1581c-9491-4e17-9661-962dd58da036 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:12:29,397 [465] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:29 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:29 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:12:29,398 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:12:29,400 [436] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:12:29,406 [436] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:12:29,417 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:12:29,422 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:12:29,425 [419] [DEBUG] [app] Starting request: urn:request:5106cae3-a1c7-4f33-be90-8d387ee01951 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:12:29,426 [419] [DEBUG] [app] Ending request: urn:request:5106cae3-a1c7-4f33-be90-8d387ee01951 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:12:29,427 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:29 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:12:29,427 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:29 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:12:29,431 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:29 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:12:29,432 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:12:29,436 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:12:29,437 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:29 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:12:29,444 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:12:29,446 [461] [DEBUG] [app] Starting request: urn:request:2c620785-046a-42ae-b39a-e715f86f7df9 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:29 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:12:29,447 [461] [DEBUG] [app] Ending request: urn:request:2c620785-046a-42ae-b39a-e715f86f7df9 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:12:29,448 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:12:29,447 [461] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:29 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:12:29,450 [436] [DEBUG] [app] Ending request: urn:request:0b7e9cd0-964f-4384-9016-9390179b74ca (/health/instance) 2020-07-23 07:12:29,450 [436] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:12:29 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.067 49 0.067) gunicorn-web stdout | 2020-07-23 07:12:29,451 [436] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:12:29 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" builder stdout | 2020-07-23 07:12:29,479 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:12:29,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:12:29,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:39.911177+00:00 (in 9.999158 seconds) 2020-07-23 07:12:29,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:12:39 UTC)" (scheduled at 2020-07-23 07:12:29.911177+00:00) 2020-07-23 07:12:29,912 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:12:29,914 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 12, 29, 912908), True, datetime.datetime(2020, 7, 23, 7, 12, 29, 912908), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:12:29,924 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:12:29,924 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:12:29,925 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:12:39 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:12:30,352 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:12:30,353 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:52.446816+00:00 (in 22.093889 seconds) 2020-07-23 07:12:30,353 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:13:00 UTC)" (scheduled at 2020-07-23 07:12:30.351857+00:00) 2020-07-23 07:12:30,353 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:12:30,356 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 12, 30, 354044), True, datetime.datetime(2020, 7, 23, 7, 12, 30, 354044), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:12:30,365 [101] [DEBUG] [workers.queueworker] No more work. security_notification_worker stdout | 2020-07-23 07:12:30,365 [101] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:12:30,365 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:13:00 UTC)" executed successfully builder stdout | 2020-07-23 07:12:30,479 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:12:31,142 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:12:31,155 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:12:31,155 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:12:31,480 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:12:32,480 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 securityworker stdout | 2020-07-23 07:12:33,477 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run securityworker stdout | 2020-07-23 07:12:33,478 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:13:03.476607+00:00 (in 29.998492 seconds) 2020-07-23 07:12:33,478 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:13:03 UTC)" (scheduled at 2020-07-23 07:12:33.476607+00:00) securityworker stdout | 2020-07-23 07:12:33,480 [128] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "image" AS "t1" WHERE ("t1"."security_indexed_engine" < %s)', [3]) builder stdout | 2020-07-23 07:12:33,480 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 securityworker stdout | 2020-07-23 07:12:33,487 [128] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "image" AS "t1"', []) securityworker stdout | 2020-07-23 07:12:33,488 [128] [DEBUG] [data.secscan_model.secscan_v2_model] Found no additional images to scan 2020-07-23 07:12:33,488 [128] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:12:33,488 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:13:03 UTC)" executed successfully builder stdout | 2020-07-23 07:12:34,481 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gcworker stdout | 2020-07-23 07:12:34,889 [110] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'gcworker.py', 'pid': '110'} expiredappspecifictokenworker stdout | 2020-07-23 07:12:35,284 [126] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '126'} builder stdout | 2020-07-23 07:12:35,481 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 securityworker stdout | 2020-07-23 07:12:35,912 [128] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'securityworker.py', 'pid': '128'} teamsyncworker stdout | 2020-07-23 07:12:36,234 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'teamsyncworker.py', 'pid': '115'} builder stdout | 2020-07-23 07:12:36,475 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 2020-07-23 07:12:36,476 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:12:35.481508 (running). builder stdout | 2020-07-23 07:12:36,481 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:12:37,481 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 exportactionlogsworker stdout | 2020-07-23 07:12:37,659 [99] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'exportactionlogsworker.py', 'pid': '99'} gunicorn-secscan stdout | 2020-07-23 07:12:37,932 [413] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '413'} gunicorn-secscan stdout | 2020-07-23 07:12:37,949 [412] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '412'} gunicorn-secscan stdout | 2020-07-23 07:12:37,966 [122] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '122'} gunicorn-secscan stdout | 2020-07-23 07:12:37,971 [411] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '411'} gunicorn-secscan stdout | 2020-07-23 07:12:37,980 [414] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '414'} queuecleanupworker stdout | 2020-07-23 07:12:38,069 [103] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'queuecleanupworker.py', 'pid': '103'} repositoryactioncounter stdout | 2020-07-23 07:12:38,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:12:38,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:48.291018+00:00 (in 9.998933 seconds) 2020-07-23 07:12:38,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:12:48 UTC)" (scheduled at 2020-07-23 07:12:38.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:12:38,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:12:38,303 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:12:38,303 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:12:38,303 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:12:48 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:12:38,383 [419] [DEBUG] [app] Starting request: urn:request:f31851f0-5070-4785-91ff-a8f3a90a59a5 (/health/instance) gunicorn-web stdout | 2020-07-23 07:12:38,386 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:12:38,392 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:12:38,394 [475] [DEBUG] [app] Starting request: urn:request:a99372c8-c213-4501-88de-0ea4bf8691e9 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:12:38,395 [475] [DEBUG] [app] Ending request: urn:request:a99372c8-c213-4501-88de-0ea4bf8691e9 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:12:38,396 [475] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:38 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:38 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:12:38,396 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:12:38,398 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:12:38,404 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:12:38,413 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:12:38,418 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:12:38,421 [436] [DEBUG] [app] Starting request: urn:request:47689994-346e-40bc-a360-482af404bf73 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:12:38,423 [436] [DEBUG] [app] Ending request: urn:request:47689994-346e-40bc-a360-482af404bf73 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:12:38,423 [436] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:38 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:12:38,424 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:38 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:12:38,429 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:38 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:12:38,430 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:12:38,433 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:38 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:12:38,435 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:12:38,440 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:12:38,442 [461] [DEBUG] [app] Starting request: urn:request:e6c8cbec-ade3-4dc1-ad4f-bf7f30b936e3 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:12:38,443 [461] [DEBUG] [app] Ending request: urn:request:e6c8cbec-ade3-4dc1-ad4f-bf7f30b936e3 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:38 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:12:38,445 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:12:38,447 [461] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:38 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:12:38,447 [419] [DEBUG] [app] Ending request: urn:request:f31851f0-5070-4785-91ff-a8f3a90a59a5 (/health/instance) 2020-07-23 07:12:38,448 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:12:38,449 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:12:38 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:12:38 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.068 49 0.068) builder stdout | 2020-07-23 07:12:38,481 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 globalpromstats stdout | 2020-07-23 07:12:38,932 [129] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'globalpromstats.py', 'pid': '129'} namespacegcworker stdout | 2020-07-23 07:12:39,027 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:12:39,028 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:13:06.910005+00:00 (in 27.882108 seconds) 2020-07-23 07:12:39,028 [134] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:13:39 UTC)" (scheduled at 2020-07-23 07:12:39.024941+00:00) 2020-07-23 07:12:39,028 [134] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:12:39,028 [134] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:13:39 UTC)" executed successfully buildlogsarchiver stdout | 2020-07-23 07:12:39,274 [109] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'buildlogsarchiver.py', 'pid': '109'} gunicorn-web stdout | 2020-07-23 07:12:39,384 [419] [DEBUG] [app] Starting request: urn:request:5ed52068-8c77-4a11-8810-c06978f88553 (/health/instance) gunicorn-web stdout | 2020-07-23 07:12:39,388 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:12:39,391 [480] [DEBUG] [app] Starting request: urn:request:84815daf-6894-4922-85fc-dc8f2ed290da (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:12:39,392 [480] [DEBUG] [app] Ending request: urn:request:84815daf-6894-4922-85fc-dc8f2ed290da (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:12:39,392 [480] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:12:39,393 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:12:39,394 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:12:39,400 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:12:39,407 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:12:39,413 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:12:39,415 [419] [DEBUG] [app] Starting request: urn:request:159f5151-e510-4ca3-b407-c1fd1a43205f (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:12:39,416 [419] [DEBUG] [app] Ending request: urn:request:159f5151-e510-4ca3-b407-c1fd1a43205f (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:12:39,417 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:12:39,418 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:12:39,422 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:39 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:12:39,423 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:12:39,427 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:12:39,428 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:39 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:12:39,432 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:12:39,434 [462] [DEBUG] [app] Starting request: urn:request:22ea541f-8f85-43f9-bccd-a78c75b9b72f (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:12:39,435 [462] [DEBUG] [app] Ending request: urn:request:22ea541f-8f85-43f9-bccd-a78c75b9b72f (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:39 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:12:39,436 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:12:39,436 [462] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:39 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:12:39,438 [419] [DEBUG] [app] Ending request: urn:request:5ed52068-8c77-4a11-8810-c06978f88553 (/health/instance) 2020-07-23 07:12:39,438 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:12:39,439 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:12:39 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:12:39 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.057 49 0.057) builder stdout | 2020-07-23 07:12:39,482 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:12:39,518 [113] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'notificationworker.py', 'pid': '113'} chunkcleanupworker stdout | 2020-07-23 07:12:39,729 [124] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'chunkcleanupworker.py', 'pid': '124'} notificationworker stdout | 2020-07-23 07:12:39,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:12:39,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:49.911177+00:00 (in 9.999004 seconds) notificationworker stdout | 2020-07-23 07:12:39,913 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:12:49 UTC)" (scheduled at 2020-07-23 07:12:39.911177+00:00) 2020-07-23 07:12:39,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:12:39,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 12, 39, 913775), True, datetime.datetime(2020, 7, 23, 7, 12, 39, 913775), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:12:39,924 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:12:39,924 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:12:39,924 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:12:49 UTC)" executed successfully gcworker stdout | 2020-07-23 07:12:40,005 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2020-07-23 07:12:40,006 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:13:10.004697+00:00 (in 29.998830 seconds) 2020-07-23 07:12:40,006 [110] [INFO] [apscheduler.executors.default] Running job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:13:10 UTC)" (scheduled at 2020-07-23 07:12:40.004697+00:00) gcworker stdout | 2020-07-23 07:12:40,008 [110] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1594278760006, 1209600, 500, 1, 0]) gcworker stdout | 2020-07-23 07:12:40,019 [110] [DEBUG] [__main__] No repository with garbage found 2020-07-23 07:12:40,019 [110] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2020-07-23 07:12:40,019 [110] [INFO] [apscheduler.executors.default] Job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:13:10 UTC)" executed successfully builder stdout | 2020-07-23 07:12:40,482 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:12:41,013 [130] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'builder.py', 'pid': '130'} builder stdout | 2020-07-23 07:12:41,157 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:12:41,169 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:12:41,169 [130] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:12:41,247 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositorygcworker.py', 'pid': '102'} namespacegcworker stdout | 2020-07-23 07:12:41,260 [134] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'namespacegcworker.py', 'pid': '134'} builder stdout | 2020-07-23 07:12:41,482 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 blobuploadcleanupworker stdout | 2020-07-23 07:12:41,710 [119] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'blobuploadcleanupworker.py', 'pid': '119'} builder stdout | 2020-07-23 07:12:42,482 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 security_notification_worker stdout | 2020-07-23 07:12:43,199 [101] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'security_notification_worker.py', 'pid': '101'} logrotateworker stdout | 2020-07-23 07:12:43,248 [118] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'logrotateworker.py', 'pid': '118'} storagereplication stdout | 2020-07-23 07:12:43,275 [133] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'storagereplication.py', 'pid': '133'} builder stdout | 2020-07-23 07:12:43,483 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:12:44,483 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:12:44,594 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositoryactioncounter.py', 'pid': '114'} servicekey stdout | 2020-07-23 07:12:45,247 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'servicekeyworker.py', 'pid': '98'} builder stdout | 2020-07-23 07:12:45,483 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:12:45,805 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '104'} gunicorn-web stdout | 2020-07-23 07:12:45,815 [435] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '435'} gunicorn-web stdout | 2020-07-23 07:12:45,826 [419] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '419'} gunicorn-web stdout | 2020-07-23 07:12:45,839 [438] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '438'} gunicorn-web stdout | 2020-07-23 07:12:45,846 [433] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '433'} gunicorn-web stdout | 2020-07-23 07:12:45,865 [431] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '431'} gunicorn-web stdout | 2020-07-23 07:12:45,877 [436] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '436'} gunicorn-web stdout | 2020-07-23 07:12:45,890 [420] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '420'} gunicorn-web stdout | 2020-07-23 07:12:45,895 [423] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '423'} builder stdout | 2020-07-23 07:12:46,478 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 2020-07-23 07:12:46,478 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:12:45.483797 (running). builder stdout | 2020-07-23 07:12:46,483 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:12:47,484 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:12:48,292 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:12:48,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:12:58 UTC)" (scheduled at 2020-07-23 07:12:48.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:12:48,293 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:58.291018+00:00 (in 9.998642 seconds) repositoryactioncounter stdout | 2020-07-23 07:12:48,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:12:48,305 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:12:48,305 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:12:48,305 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:12:58 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:12:48,383 [419] [DEBUG] [app] Starting request: urn:request:29e690d3-a301-41b3-81af-7041e5a81263 (/health/instance) gunicorn-web stdout | 2020-07-23 07:12:48,386 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:12:48,391 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:12:48,393 [467] [DEBUG] [app] Starting request: urn:request:9e9247e8-d312-4c04-b573-dbfd463cae28 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:12:48,394 [467] [DEBUG] [app] Ending request: urn:request:9e9247e8-d312-4c04-b573-dbfd463cae28 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:12:48,395 [467] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:12:48,396 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:12:48,397 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:12:48,403 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:12:48,411 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:12:48,416 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:12:48,418 [419] [DEBUG] [app] Starting request: urn:request:c5aa8601-1014-48a5-8dc6-0dd428eca2bb (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:12:48,419 [419] [DEBUG] [app] Ending request: urn:request:c5aa8601-1014-48a5-8dc6-0dd428eca2bb (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:12:48,419 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:48 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:48 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:12:48,420 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:12:48,423 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:48 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:12:48,424 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:12:48,428 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:12:48,429 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:48 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:12:48,433 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:12:48,434 [461] [DEBUG] [app] Starting request: urn:request:6b4fc78a-830c-47c8-8cd7-45f2fda8f07b (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:12:48,435 [461] [DEBUG] [app] Ending request: urn:request:6b4fc78a-830c-47c8-8cd7-45f2fda8f07b (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:12:48,436 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:48 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 162 0.002) gunicorn-verbs stdout | 2020-07-23 07:12:48,436 [461] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:48 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:12:48,438 [419] [DEBUG] [app] Ending request: urn:request:29e690d3-a301-41b3-81af-7041e5a81263 (/health/instance) 2020-07-23 07:12:48,438 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:12:48,439 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:12:48 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:12:48 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.059 49 0.059) builder stdout | 2020-07-23 07:12:48,484 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:12:49,384 [436] [DEBUG] [app] Starting request: urn:request:ba35011e-13dd-48df-a68b-cd2886b255bc (/health/instance) gunicorn-web stdout | 2020-07-23 07:12:49,387 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:12:49,392 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:12:49,394 [480] [DEBUG] [app] Starting request: urn:request:49b400ac-ed1c-45ba-a59f-4022c3280562 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:12:49,395 [480] [DEBUG] [app] Ending request: urn:request:49b400ac-ed1c-45ba-a59f-4022c3280562 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:12:49,396 [480] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:49 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:49 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:12:49,396 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:12:49,397 [436] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:12:49,402 [436] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:12:49,412 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:12:49,417 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:12:49,419 [436] [DEBUG] [app] Starting request: urn:request:69216df8-35cc-475c-9de6-095c449007cf (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:12:49,420 [436] [DEBUG] [app] Ending request: urn:request:69216df8-35cc-475c-9de6-095c449007cf (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:12:49,421 [436] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:49 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:49 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:12:49,422 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:12:49,426 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:12:49,427 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:49 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:12:49,431 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:49 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:12:49,432 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:12:49,437 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:12:49,438 [460] [DEBUG] [app] Starting request: urn:request:ed852284-2f54-4562-b68f-bfc1f2243351 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:12:49,439 [460] [DEBUG] [app] Ending request: urn:request:ed852284-2f54-4562-b68f-bfc1f2243351 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:12:49,440 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:49 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:12:49,442 [436] [DEBUG] [app] Ending request: urn:request:ba35011e-13dd-48df-a68b-cd2886b255bc (/health/instance) gunicorn-web stdout | 2020-07-23 07:12:49,442 [436] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:12:49,443 [436] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:12:49 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:12:49 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.060 49 0.060) gunicorn-verbs stdout | 2020-07-23 07:12:49,440 [460] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:49 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" builder stdout | 2020-07-23 07:12:49,484 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:12:49,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:12:49,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:12:59.911177+00:00 (in 9.999006 seconds) 2020-07-23 07:12:49,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:12:59 UTC)" (scheduled at 2020-07-23 07:12:49.911177+00:00) 2020-07-23 07:12:49,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:12:49,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 12, 49, 913082), True, datetime.datetime(2020, 7, 23, 7, 12, 49, 913082), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:12:49,925 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:12:49,925 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:12:49,926 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:12:59 UTC)" executed successfully builder stdout | 2020-07-23 07:12:50,484 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:12:50,743 [130] [DEBUG] [buildman.server] Writing metrics builder stdout | 2020-07-23 07:12:50,756 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds builder stdout | 2020-07-23 07:12:51,171 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:12:51,178 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:12:51,179 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:12:51,485 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 security_notification_worker stdout | 2020-07-23 07:12:52,447 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:12:52,447 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:13:00.351857+00:00 (in 7.904185 seconds) 2020-07-23 07:12:52,448 [101] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:13:52 UTC)" (scheduled at 2020-07-23 07:12:52.446816+00:00) 2020-07-23 07:12:52,448 [101] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:12:52,448 [101] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:13:52 UTC)" executed successfully builder stdout | 2020-07-23 07:12:52,485 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-registry stdout | 2020-07-23 07:12:52,521 [469] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '469'} gunicorn-registry stdout | 2020-07-23 07:12:52,542 [100] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '100'} gunicorn-registry stdout | 2020-07-23 07:12:52,568 [463] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '463'} gunicorn-registry stdout | 2020-07-23 07:12:52,572 [477] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '477'} gunicorn-registry stdout | 2020-07-23 07:12:52,582 [478] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '478'} gunicorn-registry stdout | 2020-07-23 07:12:52,596 [470] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '470'} gunicorn-registry stdout | 2020-07-23 07:12:52,601 [480] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '480'} gunicorn-registry stdout | 2020-07-23 07:12:52,608 [476] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '476'} gunicorn-registry stdout | 2020-07-23 07:12:52,632 [467] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '467'} gunicorn-registry stdout | 2020-07-23 07:12:52,647 [475] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '475'} gunicorn-registry stdout | 2020-07-23 07:12:52,654 [479] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '479'} gunicorn-registry stdout | 2020-07-23 07:12:52,661 [474] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '474'} gunicorn-registry stdout | 2020-07-23 07:12:52,667 [472] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '472'} gunicorn-registry stdout | 2020-07-23 07:12:52,671 [473] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '473'} gunicorn-registry stdout | 2020-07-23 07:12:52,677 [465] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '465'} gunicorn-registry stdout | 2020-07-23 07:12:52,681 [471] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '471'} gunicorn-registry stdout | 2020-07-23 07:12:52,685 [481] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '481'} builder stdout | 2020-07-23 07:12:53,485 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-verbs stdout | 2020-07-23 07:12:53,822 [127] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'verbs:application', 'pid': '127'} builder stdout | 2020-07-23 07:12:54,485 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:12:55,485 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 buildlogsarchiver stdout | 2020-07-23 07:12:56,396 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:12:56,396 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:13:26.395393+00:00 (in 29.999130 seconds) 2020-07-23 07:12:56,397 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:13:26 UTC)" (scheduled at 2020-07-23 07:12:56.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:12:56,398 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 12, 56, 397324), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:12:56,407 [109] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2020-07-23 07:12:56,407 [109] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:12:56,407 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:13:26 UTC)" executed successfully builder stdout | 2020-07-23 07:12:56,480 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:12:56,480 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:12:55.486148 (running). builder stdout | 2020-07-23 07:12:56,486 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:12:57,486 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:12:58,294 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:12:58,295 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:13:08.291018+00:00 (in 9.996152 seconds) 2020-07-23 07:12:58,295 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:13:08 UTC)" (scheduled at 2020-07-23 07:12:58.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:12:58,298 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:12:58,307 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:12:58,307 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:12:58,308 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:13:08 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:12:58,382 [419] [DEBUG] [app] Starting request: urn:request:2114b876-9fb7-422e-a58c-98206dbb4b8b (/health/instance) gunicorn-web stdout | 2020-07-23 07:12:58,385 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:12:58,390 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:12:58,392 [481] [DEBUG] [app] Starting request: urn:request:42dae2ae-090c-49db-ac6b-22d3dcee2e5d (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:12:58,394 [481] [DEBUG] [app] Ending request: urn:request:42dae2ae-090c-49db-ac6b-22d3dcee2e5d (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:12:58,395 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-registry stdout | 2020-07-23 07:12:58,396 [481] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:12:58,397 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:12:58,403 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:12:58,411 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:12:58,417 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:12:58,419 [419] [DEBUG] [app] Starting request: urn:request:863ff10c-76c4-49ba-bbe8-874137527cf6 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:12:58,420 [419] [DEBUG] [app] Ending request: urn:request:863ff10c-76c4-49ba-bbe8-874137527cf6 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:58 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:12:58,420 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:58 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:12:58,421 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:12:58,425 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:58 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:12:58,425 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:12:58,429 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:12:58,430 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:58 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:12:58,434 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:12:58,436 [461] [DEBUG] [app] Starting request: urn:request:6d9b7cb3-468f-4f98-9090-7e99b99a16fb (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:12:58,437 [461] [DEBUG] [app] Ending request: urn:request:6d9b7cb3-468f-4f98-9090-7e99b99a16fb (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:12:58,438 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:58 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:12:58,438 [461] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:58 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:12:58,440 [419] [DEBUG] [app] Ending request: urn:request:2114b876-9fb7-422e-a58c-98206dbb4b8b (/health/instance) gunicorn-web stdout | 2020-07-23 07:12:58,440 [419] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:12:58 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.060 49 0.060) gunicorn-web stdout | 2020-07-23 07:12:58,441 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:12:58 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" builder stdout | 2020-07-23 07:12:58,486 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:12:59,385 [433] [DEBUG] [app] Starting request: urn:request:1adb231b-90ba-4314-89ee-7d2fe49db2b8 (/health/instance) gunicorn-web stdout | 2020-07-23 07:12:59,392 [433] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): localhost:8443 gunicorn-web stdout | 2020-07-23 07:12:59,400 [433] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:12:59,402 [480] [DEBUG] [app] Starting request: urn:request:7c94071a-c668-4caa-ad6e-4dc5792438f5 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:12:59,403 [480] [DEBUG] [app] Ending request: urn:request:7c94071a-c668-4caa-ad6e-4dc5792438f5 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:12:59,404 [480] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:59 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:12:59,404 [433] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:59 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:12:59,408 [433] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:12:59,416 [433] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:12:59,426 [433] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:12:59,431 [433] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:12:59,433 [433] [DEBUG] [app] Starting request: urn:request:6b6c94a9-2a9f-4c60-9d92-c7ca22f33d72 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:12:59,433 [433] [DEBUG] [app] Ending request: urn:request:6b6c94a9-2a9f-4c60-9d92-c7ca22f33d72 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:12:59,434 [433] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:59 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:59 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:12:59,435 [433] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:12:59,438 [433] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:59 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:12:59,439 [433] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:12:59,443 [433] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:59 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:12:59,444 [433] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:12:59,447 [433] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2020, 7, 23, 7, 12, 59, 445933), None, u'quay', u'quay', datetime.datetime(2020, 7, 23, 7, 12, 59, 445977), u'quay', None, datetime.datetime(2020, 7, 22, 7, 12, 59, 446009), datetime.datetime(2020, 7, 16, 7, 12, 59, 446042), None]) gunicorn-web stdout | 2020-07-23 07:12:59,462 [433] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:12:59,464 [462] [DEBUG] [app] Starting request: urn:request:cdb479f6-aa94-42d2-953c-d7255cc02373 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:12:59,465 [462] [DEBUG] [app] Ending request: urn:request:cdb479f6-aa94-42d2-953c-d7255cc02373 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:12:59 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:12:59,466 [462] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:12:59 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:12:59,466 [433] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:12:59,469 [433] [DEBUG] [app] Ending request: urn:request:1adb231b-90ba-4314-89ee-7d2fe49db2b8 (/health/instance) gunicorn-web stdout | 2020-07-23 07:12:59,469 [433] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:12:59,470 [433] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:12:59 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:12:59 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.087 49 0.087) builder stdout | 2020-07-23 07:12:59,486 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:12:59,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:12:59,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:13:09.911177+00:00 (in 9.999003 seconds) 2020-07-23 07:12:59,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:13:09 UTC)" (scheduled at 2020-07-23 07:12:59.911177+00:00) 2020-07-23 07:12:59,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:12:59,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 12, 59, 913297), True, datetime.datetime(2020, 7, 23, 7, 12, 59, 913297), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:12:59,925 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:12:59,926 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:12:59,926 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:13:09 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:13:00,352 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:13:00,353 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:13:30.351857+00:00 (in 29.999067 seconds) 2020-07-23 07:13:00,353 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:13:30 UTC)" (scheduled at 2020-07-23 07:13:00.351857+00:00) security_notification_worker stdout | 2020-07-23 07:13:00,353 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:13:00,356 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 13, 0, 354023), True, datetime.datetime(2020, 7, 23, 7, 13, 0, 354023), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:13:00,364 [101] [DEBUG] [workers.queueworker] No more work. security_notification_worker stdout | 2020-07-23 07:13:00,365 [101] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:13:00,365 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:13:30 UTC)" executed successfully builder stdout | 2020-07-23 07:13:00,487 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:13:01,180 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:13:01,193 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:13:01,193 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:13:01,487 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:13:02,487 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 securityworker stdout | 2020-07-23 07:13:03,477 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run securityworker stdout | 2020-07-23 07:13:03,478 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:13:33.476607+00:00 (in 29.998898 seconds) 2020-07-23 07:13:03,478 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:13:33 UTC)" (scheduled at 2020-07-23 07:13:03.476607+00:00) 2020-07-23 07:13:03,478 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:13:33 UTC)" executed successfully builder stdout | 2020-07-23 07:13:03,488 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 exportactionlogsworker stdout | 2020-07-23 07:13:03,972 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:13:03,973 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:13:08.212267+00:00 (in 4.239534 seconds) 2020-07-23 07:13:03,973 [99] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:14:03 UTC)" (scheduled at 2020-07-23 07:13:03.971686+00:00) 2020-07-23 07:13:03,973 [99] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2020-07-23 07:13:03,976 [99] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 13, 3, 973934), True, datetime.datetime(2020, 7, 23, 7, 13, 3, 973934), 0, u'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2020-07-23 07:13:03,984 [99] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:13:03,985 [99] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2020-07-23 07:13:03,985 [99] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:14:03 UTC)" executed successfully builder stdout | 2020-07-23 07:13:04,488 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gcworker stdout | 2020-07-23 07:13:04,925 [110] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'gcworker.py', 'pid': '110'} expiredappspecifictokenworker stdout | 2020-07-23 07:13:05,322 [126] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '126'} builder stdout | 2020-07-23 07:13:05,488 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 securityworker stdout | 2020-07-23 07:13:05,951 [128] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'securityworker.py', 'pid': '128'} teamsyncworker stdout | 2020-07-23 07:13:06,273 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'teamsyncworker.py', 'pid': '115'} builder stdout | 2020-07-23 07:13:06,481 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 2020-07-23 07:13:06,482 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:13:05.488412 (running). builder stdout | 2020-07-23 07:13:06,488 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 namespacegcworker stdout | 2020-07-23 07:13:06,910 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:13:06,911 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:13:39.024941+00:00 (in 32.113932 seconds) 2020-07-23 07:13:06,911 [134] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:14:06 UTC)" (scheduled at 2020-07-23 07:13:06.910005+00:00) 2020-07-23 07:13:06,911 [134] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2020-07-23 07:13:06,913 [134] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 13, 6, 912028), True, datetime.datetime(2020, 7, 23, 7, 13, 6, 912028), 0, u'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2020-07-23 07:13:06,923 [134] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:13:06,923 [134] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:13:06,923 [134] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:14:06 UTC)" executed successfully builder stdout | 2020-07-23 07:13:07,488 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 exportactionlogsworker stdout | 2020-07-23 07:13:07,698 [99] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'exportactionlogsworker.py', 'pid': '99'} gunicorn-secscan stdout | 2020-07-23 07:13:07,945 [413] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '413'} gunicorn-secscan stdout | 2020-07-23 07:13:07,960 [412] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '412'} gunicorn-secscan stdout | 2020-07-23 07:13:07,977 [122] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '122'} gunicorn-secscan stdout | 2020-07-23 07:13:07,982 [411] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '411'} gunicorn-secscan stdout | 2020-07-23 07:13:07,993 [414] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '414'} queuecleanupworker stdout | 2020-07-23 07:13:08,108 [103] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'queuecleanupworker.py', 'pid': '103'} exportactionlogsworker stdout | 2020-07-23 07:13:08,213 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:13:08,213 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:03.971686+00:00 (in 55.757975 seconds) 2020-07-23 07:13:08,214 [99] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:14:08 UTC)" (scheduled at 2020-07-23 07:13:08.212267+00:00) 2020-07-23 07:13:08,214 [99] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:13:08,214 [99] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:14:08 UTC)" executed successfully repositoryactioncounter stdout | 2020-07-23 07:13:08,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:13:08,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:13:18.291018+00:00 (in 9.999031 seconds) 2020-07-23 07:13:08,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:13:18 UTC)" (scheduled at 2020-07-23 07:13:08.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:13:08,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:13:08,303 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:13:08,303 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:13:08,303 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:13:18 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:13:08,382 [419] [DEBUG] [app] Starting request: urn:request:adc1d3ca-9bb9-44f8-ba3c-d3d5d764cd54 (/health/instance) gunicorn-web stdout | 2020-07-23 07:13:08,385 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:13:08,391 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:13:08,392 [467] [DEBUG] [app] Starting request: urn:request:ec66393b-55d4-4f0e-b9e2-16b8f97515eb (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:13:08,394 [467] [DEBUG] [app] Ending request: urn:request:ec66393b-55d4-4f0e-b9e2-16b8f97515eb (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:08 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-registry stdout | 2020-07-23 07:13:08,395 [467] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:08 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:13:08,395 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:13:08,396 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:13:08,402 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:13:08,409 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:13:08,414 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:13:08,416 [419] [DEBUG] [app] Starting request: urn:request:3661dcc4-b184-4cbc-9182-29f4c548d2d2 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:08,417 [419] [DEBUG] [app] Ending request: urn:request:3661dcc4-b184-4cbc-9182-29f4c548d2d2 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:08,417 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:08 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:08 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:13:08,418 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:13:08,422 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:08 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:13:08,423 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:13:08,427 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:08 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.002 153 0.002) gunicorn-web stdout | 2020-07-23 07:13:08,429 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:13:08,434 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:13:08,436 [462] [DEBUG] [app] Starting request: urn:request:00c31eac-42d1-46d8-9f89-a10f7db24c74 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:08 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:13:08,437 [462] [DEBUG] [app] Ending request: urn:request:00c31eac-42d1-46d8-9f89-a10f7db24c74 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:08,437 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:13:08,437 [462] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:08 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:13:08,439 [419] [DEBUG] [app] Ending request: urn:request:adc1d3ca-9bb9-44f8-ba3c-d3d5d764cd54 (/health/instance) 2020-07-23 07:13:08,440 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:13:08,440 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:13:08 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:13:08 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.061 49 0.061) builder stdout | 2020-07-23 07:13:08,489 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 globalpromstats stdout | 2020-07-23 07:13:08,964 [129] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'globalpromstats.py', 'pid': '129'} buildlogsarchiver stdout | 2020-07-23 07:13:09,313 [109] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'buildlogsarchiver.py', 'pid': '109'} gunicorn-web stdout | 2020-07-23 07:13:09,384 [438] [DEBUG] [app] Starting request: urn:request:78b568a1-d67f-4614-b90b-097024bdcc4f (/health/instance) gunicorn-web stdout | 2020-07-23 07:13:09,387 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:13:09,392 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:13:09,394 [476] [DEBUG] [app] Starting request: urn:request:582dd7bf-f0c4-4e5d-982f-383b1aeed8e7 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:13:09,395 [476] [DEBUG] [app] Ending request: urn:request:582dd7bf-f0c4-4e5d-982f-383b1aeed8e7 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-registry stdout | 2020-07-23 07:13:09,396 [476] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:13:09,397 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:13:09,398 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:13:09,404 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:13:09,412 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:13:09,418 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:13:09,420 [438] [DEBUG] [app] Starting request: urn:request:b7fa8d8a-1f89-4e55-96a3-f994901ea7bc (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:09,421 [438] [DEBUG] [app] Ending request: urn:request:b7fa8d8a-1f89-4e55-96a3-f994901ea7bc (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:09,422 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:13:09,422 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:13:09,426 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:09 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:13:09,427 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:13:09,430 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:13:09,432 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:09 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:13:09,435 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:13:09,437 [462] [DEBUG] [app] Starting request: urn:request:b7ecbe94-e5e9-44a3-a257-e71836be755c (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:13:09,439 [462] [DEBUG] [app] Ending request: urn:request:b7ecbe94-e5e9-44a3-a257-e71836be755c (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:09,440 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:09 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:13:09,440 [462] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:09 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:13:09,442 [438] [DEBUG] [app] Ending request: urn:request:78b568a1-d67f-4614-b90b-097024bdcc4f (/health/instance) 2020-07-23 07:13:09,442 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:13:09,443 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:13:09 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:13:09 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.061 49 0.061) builder stdout | 2020-07-23 07:13:09,489 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:13:09,556 [113] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'notificationworker.py', 'pid': '113'} chunkcleanupworker stdout | 2020-07-23 07:13:09,767 [124] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'chunkcleanupworker.py', 'pid': '124'} notificationworker stdout | 2020-07-23 07:13:09,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:13:09,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:13:11.998621+00:00 (in 2.086420 seconds) 2020-07-23 07:13:09,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:13:19 UTC)" (scheduled at 2020-07-23 07:13:09.911177+00:00) 2020-07-23 07:13:09,912 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:13:09,914 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 13, 9, 912974), True, datetime.datetime(2020, 7, 23, 7, 13, 9, 912974), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:13:09,923 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:13:09,923 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:13:09,924 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:13:19 UTC)" executed successfully gcworker stdout | 2020-07-23 07:13:10,005 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2020-07-23 07:13:10,006 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:13:40.004697+00:00 (in 29.999012 seconds) 2020-07-23 07:13:10,006 [110] [INFO] [apscheduler.executors.default] Running job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:13:40 UTC)" (scheduled at 2020-07-23 07:13:10.004697+00:00) gcworker stdout | 2020-07-23 07:13:10,008 [110] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1594278790006, 1209600, 500, 1, 0]) gcworker stdout | 2020-07-23 07:13:10,017 [110] [DEBUG] [__main__] No repository with garbage found 2020-07-23 07:13:10,017 [110] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2020-07-23 07:13:10,018 [110] [INFO] [apscheduler.executors.default] Job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:13:40 UTC)" executed successfully builder stdout | 2020-07-23 07:13:10,489 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:13:11,053 [130] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'builder.py', 'pid': '130'} builder stdout | 2020-07-23 07:13:11,194 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:13:11,207 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:13:11,207 [130] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:13:11,285 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositorygcworker.py', 'pid': '102'} namespacegcworker stdout | 2020-07-23 07:13:11,305 [134] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'namespacegcworker.py', 'pid': '134'} builder stdout | 2020-07-23 07:13:11,490 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 blobuploadcleanupworker stdout | 2020-07-23 07:13:11,748 [119] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'blobuploadcleanupworker.py', 'pid': '119'} notificationworker stdout | 2020-07-23 07:13:11,999 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:13:11,999 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:13:19.911177+00:00 (in 7.911560 seconds) 2020-07-23 07:13:12,000 [113] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:14:11 UTC)" (scheduled at 2020-07-23 07:13:11.998621+00:00) notificationworker stdout | 2020-07-23 07:13:12,000 [113] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:13:12,001 [113] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:14:11 UTC)" executed successfully builder stdout | 2020-07-23 07:13:12,490 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 security_notification_worker stdout | 2020-07-23 07:13:13,239 [101] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'security_notification_worker.py', 'pid': '101'} logrotateworker stdout | 2020-07-23 07:13:13,307 [118] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'logrotateworker.py', 'pid': '118'} storagereplication stdout | 2020-07-23 07:13:13,314 [133] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'storagereplication.py', 'pid': '133'} builder stdout | 2020-07-23 07:13:13,490 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:13:14,490 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:13:14,631 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositoryactioncounter.py', 'pid': '114'} servicekey stdout | 2020-07-23 07:13:15,284 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'servicekeyworker.py', 'pid': '98'} builder stdout | 2020-07-23 07:13:15,491 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:13:15,817 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '104'} gunicorn-web stdout | 2020-07-23 07:13:15,827 [435] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '435'} gunicorn-web stdout | 2020-07-23 07:13:15,837 [419] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '419'} gunicorn-web stdout | 2020-07-23 07:13:15,849 [438] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '438'} gunicorn-web stdout | 2020-07-23 07:13:15,857 [433] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '433'} gunicorn-web stdout | 2020-07-23 07:13:15,877 [431] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '431'} gunicorn-web stdout | 2020-07-23 07:13:15,887 [436] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '436'} gunicorn-web stdout | 2020-07-23 07:13:15,901 [420] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '420'} gunicorn-web stdout | 2020-07-23 07:13:15,906 [423] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '423'} builder stdout | 2020-07-23 07:13:16,483 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:13:16,484 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:13:15.491655 (running). builder stdout | 2020-07-23 07:13:16,491 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:13:17,491 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:13:18,292 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:13:18,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:13:28.291018+00:00 (in 9.998548 seconds) 2020-07-23 07:13:18,293 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:13:28 UTC)" (scheduled at 2020-07-23 07:13:18.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:13:18,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:13:18,306 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:13:18,306 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:13:18,306 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:13:28 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:13:18,382 [433] [DEBUG] [app] Starting request: urn:request:47794015-eaef-4c68-bae5-36aec5aef0fd (/health/instance) gunicorn-web stdout | 2020-07-23 07:13:18,385 [433] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:13:18,390 [433] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:13:18,395 [479] [DEBUG] [app] Starting request: urn:request:04ac2e59-866e-404f-9ad0-9b4a5b3e0f3a (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:13:18,398 [479] [DEBUG] [app] Ending request: urn:request:04ac2e59-866e-404f-9ad0-9b4a5b3e0f3a (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:18 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.008 162 0.008) gunicorn-web stdout | 2020-07-23 07:13:18,400 [433] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-registry stdout | 2020-07-23 07:13:18,399 [479] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:18 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:13:18,401 [433] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:13:18,407 [433] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:13:18,414 [433] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:13:18,419 [433] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:13:18,421 [433] [DEBUG] [app] Starting request: urn:request:42dcaf73-7e78-4f79-b561-ff203b6dfb2f (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:18,422 [433] [DEBUG] [app] Ending request: urn:request:42dcaf73-7e78-4f79-b561-ff203b6dfb2f (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:18,423 [433] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:18 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:18 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:13:18,424 [433] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:13:18,427 [433] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:18 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:13:18,428 [433] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:13:18,432 [433] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:13:18,433 [433] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:18 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:13:18,436 [433] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:13:18,438 [468] [DEBUG] [app] Starting request: urn:request:2da8e620-c9df-460f-9dc4-c69156b6dbaf (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:13:18,439 [468] [DEBUG] [app] Ending request: urn:request:2da8e620-c9df-460f-9dc4-c69156b6dbaf (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:18,440 [433] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:18 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 162 0.002) gunicorn-verbs stdout | 2020-07-23 07:13:18,440 [468] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:18 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:13:18,441 [433] [DEBUG] [app] Ending request: urn:request:47794015-eaef-4c68-bae5-36aec5aef0fd (/health/instance) 2020-07-23 07:13:18,442 [433] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:13:18,442 [433] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:13:18 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:13:18 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.062 49 0.062) builder stdout | 2020-07-23 07:13:18,491 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:13:19,384 [438] [DEBUG] [app] Starting request: urn:request:6e3ba2c7-a756-4004-8c01-93625bd3cc43 (/health/instance) gunicorn-web stdout | 2020-07-23 07:13:19,387 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:13:19,392 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:13:19,394 [478] [DEBUG] [app] Starting request: urn:request:346d6e09-7fb9-4ac9-a08d-20fdfcf94ccb (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:13:19,395 [478] [DEBUG] [app] Ending request: urn:request:346d6e09-7fb9-4ac9-a08d-20fdfcf94ccb (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:13:19,396 [478] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:19 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:13:19,397 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:19 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:13:19,397 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:13:19,403 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:13:19,411 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:13:19,417 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:13:19,418 [438] [DEBUG] [app] Starting request: urn:request:2865decc-19b9-42cd-86f1-1db7bf8b38af (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:19,419 [438] [DEBUG] [app] Ending request: urn:request:2865decc-19b9-42cd-86f1-1db7bf8b38af (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:19,420 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:19 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:19 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:13:19,420 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:13:19,424 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:13:19,425 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:19 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:13:19,429 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:13:19,430 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:19 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:13:19,434 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:13:19,436 [466] [DEBUG] [app] Starting request: urn:request:d4945ce9-c8ee-4302-9b67-7136fc8a4a17 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:13:19,438 [466] [DEBUG] [app] Ending request: urn:request:d4945ce9-c8ee-4302-9b67-7136fc8a4a17 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:19 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:13:19,438 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:19 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:13:19,439 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:13:19,441 [438] [DEBUG] [app] Ending request: urn:request:6e3ba2c7-a756-4004-8c01-93625bd3cc43 (/health/instance) 2020-07-23 07:13:19,441 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:13:19,442 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:13:19 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:13:19 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.059 49 0.059) builder stdout | 2020-07-23 07:13:19,491 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:13:19,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:13:19,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:13:29.911177+00:00 (in 9.999045 seconds) 2020-07-23 07:13:19,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:13:29 UTC)" (scheduled at 2020-07-23 07:13:19.911177+00:00) 2020-07-23 07:13:19,912 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:13:19,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 13, 19, 913038), True, datetime.datetime(2020, 7, 23, 7, 13, 19, 913038), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:13:19,924 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:13:19,924 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:13:19,924 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:13:29 UTC)" executed successfully builder stdout | 2020-07-23 07:13:20,492 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:13:20,758 [130] [DEBUG] [buildman.server] Writing metrics builder stdout | 2020-07-23 07:13:20,771 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds builder stdout | 2020-07-23 07:13:21,209 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:13:21,215 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:13:21,215 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:13:21,492 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositorygcworker stdout | 2020-07-23 07:13:21,739 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:13:21,740 [102] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:14:21 UTC)" (scheduled at 2020-07-23 07:13:21.739118+00:00) 2020-07-23 07:13:21,740 [102] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2020-07-23 07:13:21,740 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:13:28.907644+00:00 (in 7.167681 seconds) repositorygcworker stdout | 2020-07-23 07:13:21,743 [102] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 13, 21, 740988), True, datetime.datetime(2020, 7, 23, 7, 13, 21, 740988), 0, u'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2020-07-23 07:13:21,752 [102] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2020-07-23 07:13:21,752 [102] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:13:21,753 [102] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:14:21 UTC)" executed successfully builder stdout | 2020-07-23 07:13:22,492 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-registry stdout | 2020-07-23 07:13:22,534 [469] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '469'} gunicorn-registry stdout | 2020-07-23 07:13:22,555 [100] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '100'} gunicorn-registry stdout | 2020-07-23 07:13:22,582 [463] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '463'} gunicorn-registry stdout | 2020-07-23 07:13:22,586 [477] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '477'} gunicorn-registry stdout | 2020-07-23 07:13:22,592 [478] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '478'} gunicorn-registry stdout | 2020-07-23 07:13:22,608 [470] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '470'} gunicorn-registry stdout | 2020-07-23 07:13:22,615 [480] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '480'} gunicorn-registry stdout | 2020-07-23 07:13:22,618 [476] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '476'} gunicorn-registry stdout | 2020-07-23 07:13:22,646 [467] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '467'} gunicorn-registry stdout | 2020-07-23 07:13:22,659 [475] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '475'} gunicorn-registry stdout | 2020-07-23 07:13:22,668 [479] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '479'} gunicorn-registry stdout | 2020-07-23 07:13:22,673 [474] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '474'} gunicorn-registry stdout | 2020-07-23 07:13:22,679 [472] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '472'} gunicorn-registry stdout | 2020-07-23 07:13:22,686 [473] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '473'} gunicorn-registry stdout | 2020-07-23 07:13:22,690 [465] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '465'} gunicorn-registry stdout | 2020-07-23 07:13:22,696 [471] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '471'} gunicorn-registry stdout | 2020-07-23 07:13:22,701 [481] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '481'} builder stdout | 2020-07-23 07:13:23,492 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-verbs stdout | 2020-07-23 07:13:23,932 [127] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'verbs:application', 'pid': '127'} builder stdout | 2020-07-23 07:13:24,493 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:13:25,493 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 buildlogsarchiver stdout | 2020-07-23 07:13:26,396 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:13:26,396 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:13:56.395393+00:00 (in 29.998979 seconds) 2020-07-23 07:13:26,397 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:13:56 UTC)" (scheduled at 2020-07-23 07:13:26.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:13:26,398 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 13, 26, 397523), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:13:26,406 [109] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2020-07-23 07:13:26,406 [109] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:13:26,407 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:13:56 UTC)" executed successfully builder stdout | 2020-07-23 07:13:26,485 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:13:26,486 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:13:25.493723 (running). builder stdout | 2020-07-23 07:13:26,493 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:13:27,494 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:13:28,293 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:13:28,293 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:13:38.291018+00:00 (in 9.997680 seconds) repositoryactioncounter stdout | 2020-07-23 07:13:28,296 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:13:38 UTC)" (scheduled at 2020-07-23 07:13:28.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:13:28,298 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:13:28,307 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:13:28,308 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:13:28,308 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:13:38 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:13:28,382 [438] [DEBUG] [app] Starting request: urn:request:41a7dbe6-08ad-4883-a03b-445185ffeeb0 (/health/instance) gunicorn-web stdout | 2020-07-23 07:13:28,385 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:13:28,391 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:13:28,392 [480] [DEBUG] [app] Starting request: urn:request:71e3e117-4e46-45a8-a0ed-f78854b8cdaa (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:13:28,394 [480] [DEBUG] [app] Ending request: urn:request:71e3e117-4e46-45a8-a0ed-f78854b8cdaa (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:13:28,394 [480] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:28 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:13:28,395 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:28 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:13:28,396 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:13:28,402 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:13:28,410 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:13:28,416 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:13:28,418 [419] [DEBUG] [app] Starting request: urn:request:2c5c7d9c-c936-4913-bf57-54e4dcc65307 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:28,420 [419] [DEBUG] [app] Ending request: urn:request:2c5c7d9c-c936-4913-bf57-54e4dcc65307 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:28,420 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:28 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:28 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:13:28,421 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:13:28,425 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:28 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:13:28,426 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:13:28,429 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:13:28,431 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:28 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:13:28,434 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:13:28,436 [466] [DEBUG] [app] Starting request: urn:request:ae7a27f1-eaf8-40f6-a393-5d77b5343021 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:13:28,437 [466] [DEBUG] [app] Ending request: urn:request:ae7a27f1-eaf8-40f6-a393-5d77b5343021 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:28 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-verbs stdout | 2020-07-23 07:13:28,437 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:28 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:13:28,438 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:13:28,440 [438] [DEBUG] [app] Ending request: urn:request:41a7dbe6-08ad-4883-a03b-445185ffeeb0 (/health/instance) 2020-07-23 07:13:28,441 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:13:28,442 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:13:28 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:13:28 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.060 49 0.060) builder stdout | 2020-07-23 07:13:28,494 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositorygcworker stdout | 2020-07-23 07:13:28,911 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:13:28,912 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:21.739118+00:00 (in 52.827382 seconds) 2020-07-23 07:13:28,912 [102] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:14:28 UTC)" (scheduled at 2020-07-23 07:13:28.907644+00:00) 2020-07-23 07:13:28,912 [102] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:13:28,912 [102] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:14:28 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:13:29,384 [419] [DEBUG] [app] Starting request: urn:request:acb19703-e78c-42b8-b924-3dbad3eca768 (/health/instance) gunicorn-web stdout | 2020-07-23 07:13:29,387 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:13:29,392 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:13:29,394 [467] [DEBUG] [app] Starting request: urn:request:d6e8a61a-fe9b-45b4-8ffa-dbc02b49e7cb (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:13:29,395 [467] [DEBUG] [app] Ending request: urn:request:d6e8a61a-fe9b-45b4-8ffa-dbc02b49e7cb (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:29 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-registry stdout | 2020-07-23 07:13:29,395 [467] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:29 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:13:29,396 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:13:29,397 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:13:29,403 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:13:29,411 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:13:29,415 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:13:29,417 [419] [DEBUG] [app] Starting request: urn:request:c9e87497-19da-4bfe-acfd-5c87e44f76e3 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:29,418 [419] [DEBUG] [app] Ending request: urn:request:c9e87497-19da-4bfe-acfd-5c87e44f76e3 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:29,418 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:29 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:29 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 159 0.002) gunicorn-web stdout | 2020-07-23 07:13:29,419 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:13:29,423 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:13:29,424 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:29 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:13:29,427 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:13:29,428 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:29 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:13:29,432 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:13:29,433 [466] [DEBUG] [app] Starting request: urn:request:dd2e1048-4695-4074-9a83-707feb5257d0 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:13:29,434 [466] [DEBUG] [app] Ending request: urn:request:dd2e1048-4695-4074-9a83-707feb5257d0 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:29,435 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:29 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 162 0.002) gunicorn-verbs stdout | 2020-07-23 07:13:29,435 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:29 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:13:29,437 [419] [DEBUG] [app] Ending request: urn:request:acb19703-e78c-42b8-b924-3dbad3eca768 (/health/instance) 2020-07-23 07:13:29,437 [419] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:13:29 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.055 49 0.055) gunicorn-web stdout | 2020-07-23 07:13:29,438 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:13:29 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" builder stdout | 2020-07-23 07:13:29,494 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:13:29,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:13:29,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:13:39.911177+00:00 (in 9.999069 seconds) 2020-07-23 07:13:29,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:13:39 UTC)" (scheduled at 2020-07-23 07:13:29.911177+00:00) 2020-07-23 07:13:29,912 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:13:29,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 13, 29, 913000), True, datetime.datetime(2020, 7, 23, 7, 13, 29, 913000), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:13:29,925 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:13:29,925 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:13:29,925 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:13:39 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:13:30,353 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:13:30,353 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:13:52.446816+00:00 (in 22.093532 seconds) 2020-07-23 07:13:30,354 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:14:00 UTC)" (scheduled at 2020-07-23 07:13:30.351857+00:00) 2020-07-23 07:13:30,354 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:13:30,355 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 13, 30, 354247), True, datetime.datetime(2020, 7, 23, 7, 13, 30, 354247), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:13:30,364 [101] [DEBUG] [workers.queueworker] No more work. security_notification_worker stdout | 2020-07-23 07:13:30,365 [101] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:13:30,365 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:14:00 UTC)" executed successfully builder stdout | 2020-07-23 07:13:30,494 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:13:31,217 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:13:31,229 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:13:31,229 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:13:31,495 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:13:32,495 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 securityworker stdout | 2020-07-23 07:13:33,477 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run securityworker stdout | 2020-07-23 07:13:33,478 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:03.476607+00:00 (in 29.999025 seconds) 2020-07-23 07:13:33,478 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:14:03 UTC)" (scheduled at 2020-07-23 07:13:33.476607+00:00) 2020-07-23 07:13:33,478 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:14:03 UTC)" executed successfully builder stdout | 2020-07-23 07:13:33,495 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:13:34,495 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gcworker stdout | 2020-07-23 07:13:34,963 [110] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'gcworker.py', 'pid': '110'} expiredappspecifictokenworker stdout | 2020-07-23 07:13:35,360 [126] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '126'} builder stdout | 2020-07-23 07:13:35,495 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 securityworker stdout | 2020-07-23 07:13:35,992 [128] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'securityworker.py', 'pid': '128'} teamsyncworker stdout | 2020-07-23 07:13:36,314 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'teamsyncworker.py', 'pid': '115'} builder stdout | 2020-07-23 07:13:36,487 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:13:36,488 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:13:35.496160 (running). builder stdout | 2020-07-23 07:13:36,495 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:13:37,496 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 exportactionlogsworker stdout | 2020-07-23 07:13:37,726 [99] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'exportactionlogsworker.py', 'pid': '99'} gunicorn-secscan stdout | 2020-07-23 07:13:37,956 [413] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '413'} gunicorn-secscan stdout | 2020-07-23 07:13:37,971 [412] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '412'} gunicorn-secscan stdout | 2020-07-23 07:13:37,992 [122] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '122'} gunicorn-secscan stdout | 2020-07-23 07:13:37,998 [411] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '411'} gunicorn-secscan stdout | 2020-07-23 07:13:38,004 [414] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '414'} queuecleanupworker stdout | 2020-07-23 07:13:38,146 [103] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'queuecleanupworker.py', 'pid': '103'} repositoryactioncounter stdout | 2020-07-23 07:13:38,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:13:38,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:13:48.291018+00:00 (in 9.999018 seconds) 2020-07-23 07:13:38,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:13:48 UTC)" (scheduled at 2020-07-23 07:13:38.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:13:38,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:13:38,304 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:13:38,304 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:13:38,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:13:48 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:13:38,382 [438] [DEBUG] [app] Starting request: urn:request:f7ab3959-34a5-4da3-bc7b-c8755bdcfe1f (/health/instance) gunicorn-web stdout | 2020-07-23 07:13:38,385 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:13:38,391 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:13:38,394 [463] [DEBUG] [app] Starting request: urn:request:a1e71402-eec3-491a-9c86-f77c484b9926 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:13:38,397 [463] [DEBUG] [app] Ending request: urn:request:a1e71402-eec3-491a-9c86-f77c484b9926 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:13:38,398 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:38 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:38 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.006 162 0.006) gunicorn-web stdout | 2020-07-23 07:13:38,399 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:13:38,400 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:13:38,406 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:13:38,415 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:13:38,420 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:13:38,423 [435] [DEBUG] [app] Starting request: urn:request:43a2ef14-5404-4cb2-8cbf-0e5b87c1cddf (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:38,424 [435] [DEBUG] [app] Ending request: urn:request:43a2ef14-5404-4cb2-8cbf-0e5b87c1cddf (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:38,425 [435] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:38 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:38 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:13:38,426 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:13:38,431 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:38 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:13:38,433 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:13:38,437 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:38 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:13:38,439 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:13:38,443 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:13:38,447 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:38 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 162 0.002) gunicorn-verbs stdout | 2020-07-23 07:13:38,445 [460] [DEBUG] [app] Starting request: urn:request:1983ff31-65f0-4275-af14-298d62c090f5 (/c1/_internal_ping) 2020-07-23 07:13:38,446 [460] [DEBUG] [app] Ending request: urn:request:1983ff31-65f0-4275-af14-298d62c090f5 (/c1/_internal_ping) 2020-07-23 07:13:38,447 [460] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:38 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:13:38,449 [438] [DEBUG] [app] Ending request: urn:request:f7ab3959-34a5-4da3-bc7b-c8755bdcfe1f (/health/instance) 2020-07-23 07:13:38,450 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:13:38,451 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:13:38 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:13:38 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.070 49 0.070) builder stdout | 2020-07-23 07:13:38,496 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 globalpromstats stdout | 2020-07-23 07:13:38,995 [129] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'globalpromstats.py', 'pid': '129'} namespacegcworker stdout | 2020-07-23 07:13:39,028 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:13:39,028 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:06.910005+00:00 (in 27.881342 seconds) 2020-07-23 07:13:39,029 [134] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:14:39 UTC)" (scheduled at 2020-07-23 07:13:39.024941+00:00) 2020-07-23 07:13:39,029 [134] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:13:39,029 [134] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:14:39 UTC)" executed successfully buildlogsarchiver stdout | 2020-07-23 07:13:39,352 [109] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'buildlogsarchiver.py', 'pid': '109'} gunicorn-web stdout | 2020-07-23 07:13:39,384 [431] [DEBUG] [app] Starting request: urn:request:c8084500-eb00-4705-86f3-49f0d1c51248 (/health/instance) gunicorn-web stdout | 2020-07-23 07:13:39,387 [431] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:13:39,392 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:13:39,394 [480] [DEBUG] [app] Starting request: urn:request:5deab8ab-5288-45be-be8b-a92eb0680ac3 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:13:39,395 [480] [DEBUG] [app] Ending request: urn:request:5deab8ab-5288-45be-be8b-a92eb0680ac3 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:13:39,396 [480] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:13:39,396 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:13:39,397 [431] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:13:39,404 [431] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:13:39,412 [431] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:13:39,418 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:13:39,420 [431] [DEBUG] [app] Starting request: urn:request:044ac71d-7510-48c8-8d75-cec5379a9985 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:39,421 [431] [DEBUG] [app] Ending request: urn:request:044ac71d-7510-48c8-8d75-cec5379a9985 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:39,422 [431] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:13:39,422 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:13:39,426 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:39 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:13:39,427 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:13:39,431 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:39 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:13:39,432 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:13:39,436 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:13:39,438 [466] [DEBUG] [app] Starting request: urn:request:8e915e2d-6a92-47e7-9593-1f1cdbcccdbb (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:13:39,439 [466] [DEBUG] [app] Ending request: urn:request:8e915e2d-6a92-47e7-9593-1f1cdbcccdbb (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:39,440 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:39 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:13:39,440 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:39 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:13:39,442 [431] [DEBUG] [app] Ending request: urn:request:c8084500-eb00-4705-86f3-49f0d1c51248 (/health/instance) 2020-07-23 07:13:39,442 [431] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:13:39,443 [431] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:13:39 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:13:39 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.061 49 0.061) builder stdout | 2020-07-23 07:13:39,496 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:13:39,592 [113] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'notificationworker.py', 'pid': '113'} chunkcleanupworker stdout | 2020-07-23 07:13:39,806 [124] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'chunkcleanupworker.py', 'pid': '124'} notificationworker stdout | 2020-07-23 07:13:39,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:13:39,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:13:39 UTC)" (scheduled at 2020-07-23 07:13:39.911177+00:00) 2020-07-23 07:13:39,912 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:13:39,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 13, 39, 912886), True, datetime.datetime(2020, 7, 23, 7, 13, 39, 912886), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:13:39,915 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:13:49.911177+00:00 (in 9.999056 seconds) notificationworker stdout | 2020-07-23 07:13:39,925 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:13:39,925 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:13:39,925 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:13:49 UTC)" executed successfully gcworker stdout | 2020-07-23 07:13:40,005 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2020-07-23 07:13:40,006 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:10.004697+00:00 (in 29.998992 seconds) 2020-07-23 07:13:40,006 [110] [INFO] [apscheduler.executors.default] Running job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:14:10 UTC)" (scheduled at 2020-07-23 07:13:40.004697+00:00) gcworker stdout | 2020-07-23 07:13:40,008 [110] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1594278820006, 1209600, 500, 1, 0]) gcworker stdout | 2020-07-23 07:13:40,017 [110] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2020-07-23 07:13:40,018 [110] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:13:40,018 [110] [INFO] [apscheduler.executors.default] Job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:14:10 UTC)" executed successfully builder stdout | 2020-07-23 07:13:40,497 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:13:41,103 [130] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'builder.py', 'pid': '130'} builder stdout | 2020-07-23 07:13:41,230 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:13:41,244 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:13:41,244 [130] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2020-07-23 07:13:41,327 [134] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'namespacegcworker.py', 'pid': '134'} repositorygcworker stdout | 2020-07-23 07:13:41,332 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositorygcworker.py', 'pid': '102'} builder stdout | 2020-07-23 07:13:41,497 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 blobuploadcleanupworker stdout | 2020-07-23 07:13:41,786 [119] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'blobuploadcleanupworker.py', 'pid': '119'} builder stdout | 2020-07-23 07:13:42,497 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 security_notification_worker stdout | 2020-07-23 07:13:43,286 [101] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'security_notification_worker.py', 'pid': '101'} logrotateworker stdout | 2020-07-23 07:13:43,347 [118] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'logrotateworker.py', 'pid': '118'} storagereplication stdout | 2020-07-23 07:13:43,353 [133] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'storagereplication.py', 'pid': '133'} builder stdout | 2020-07-23 07:13:43,497 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:13:44,497 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:13:44,670 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositoryactioncounter.py', 'pid': '114'} servicekey stdout | 2020-07-23 07:13:45,324 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'servicekeyworker.py', 'pid': '98'} builder stdout | 2020-07-23 07:13:45,498 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:13:45,828 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '104'} gunicorn-web stdout | 2020-07-23 07:13:45,838 [435] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '435'} gunicorn-web stdout | 2020-07-23 07:13:45,848 [419] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '419'} gunicorn-web stdout | 2020-07-23 07:13:45,859 [438] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '438'} gunicorn-web stdout | 2020-07-23 07:13:45,868 [433] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '433'} gunicorn-web stdout | 2020-07-23 07:13:45,887 [431] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '431'} gunicorn-web stdout | 2020-07-23 07:13:45,899 [436] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '436'} gunicorn-web stdout | 2020-07-23 07:13:45,913 [420] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '420'} gunicorn-web stdout | 2020-07-23 07:13:45,917 [423] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '423'} builder stdout | 2020-07-23 07:13:46,491 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:13:46,491 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:13:45.498212 (running). builder stdout | 2020-07-23 07:13:46,498 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:13:47,498 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:13:48,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:13:48,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:13:58.291018+00:00 (in 9.998832 seconds) 2020-07-23 07:13:48,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:13:58 UTC)" (scheduled at 2020-07-23 07:13:48.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:13:48,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:13:48,304 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:13:48,304 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:13:48,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:13:58 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:13:48,382 [419] [DEBUG] [app] Starting request: urn:request:302a93fb-3339-4ece-9ba9-fb190d20fe0b (/health/instance) gunicorn-web stdout | 2020-07-23 07:13:48,385 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:13:48,390 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:13:48,392 [474] [DEBUG] [app] Starting request: urn:request:aa11996e-1c09-4380-b0fa-851e0b3b7933 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:13:48,393 [474] [DEBUG] [app] Ending request: urn:request:aa11996e-1c09-4380-b0fa-851e0b3b7933 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:13:48,394 [474] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:13:48,394 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:13:48,395 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:13:48,401 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:13:48,409 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:13:48,414 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:13:48,415 [419] [DEBUG] [app] Starting request: urn:request:5b2ec0c5-4bf8-44a4-b5ed-483cb338b19e (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:48,416 [419] [DEBUG] [app] Ending request: urn:request:5b2ec0c5-4bf8-44a4-b5ed-483cb338b19e (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:48,417 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:48 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:13:48,418 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:48 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:13:48,421 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:48 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:13:48,422 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:13:48,425 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:13:48,426 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:48 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:13:48,430 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:13:48,432 [468] [DEBUG] [app] Starting request: urn:request:45f05f7d-ad82-42af-af2e-64700d351dc2 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:13:48,433 [468] [DEBUG] [app] Ending request: urn:request:45f05f7d-ad82-42af-af2e-64700d351dc2 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:48 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:13:48,434 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:13:48,433 [468] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:48 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:13:48,436 [419] [DEBUG] [app] Ending request: urn:request:302a93fb-3339-4ece-9ba9-fb190d20fe0b (/health/instance) 2020-07-23 07:13:48,436 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:13:48,437 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:13:48 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:13:48 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.056 49 0.056) builder stdout | 2020-07-23 07:13:48,499 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:13:49,385 [438] [DEBUG] [app] Starting request: urn:request:71d1faf4-1bc5-46c4-a23d-5103493215fb (/health/instance) gunicorn-web stdout | 2020-07-23 07:13:49,387 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:13:49,393 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:13:49,395 [480] [DEBUG] [app] Starting request: urn:request:793d11d7-2c2c-42ca-8d63-a5478eefdb4f (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:13:49,396 [480] [DEBUG] [app] Ending request: urn:request:793d11d7-2c2c-42ca-8d63-a5478eefdb4f (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:13:49,397 [480] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:49 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:49 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:13:49,397 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:13:49,399 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:13:49,405 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:13:49,413 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:13:49,418 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:13:49,420 [438] [DEBUG] [app] Starting request: urn:request:0bcbb6c7-4a03-40ed-91c2-803dfef84bdb (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:49,421 [438] [DEBUG] [app] Ending request: urn:request:0bcbb6c7-4a03-40ed-91c2-803dfef84bdb (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:49,422 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:49 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:49 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:13:49,422 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:13:49,426 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:49 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:13:49,426 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:13:49,430 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:49 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:13:49,431 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:13:49,435 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:13:49,436 [461] [DEBUG] [app] Starting request: urn:request:e0d8cd3e-c8d6-4f27-a05f-497ab6973b81 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:13:49,437 [461] [DEBUG] [app] Ending request: urn:request:e0d8cd3e-c8d6-4f27-a05f-497ab6973b81 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:49 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:13:49,438 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:13:49,438 [461] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:49 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:13:49,440 [438] [DEBUG] [app] Ending request: urn:request:71d1faf4-1bc5-46c4-a23d-5103493215fb (/health/instance) 2020-07-23 07:13:49,440 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:13:49,441 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:13:49 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:13:49 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.059 49 0.059) builder stdout | 2020-07-23 07:13:49,499 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:13:49,932 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:13:49,933 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:13:59.911177+00:00 (in 9.978011 seconds) 2020-07-23 07:13:49,935 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:13:59 UTC)" (scheduled at 2020-07-23 07:13:49.911177+00:00) 2020-07-23 07:13:49,935 [113] [DEBUG] [workers.queueworker] Getting work item from queue. 2020-07-23 07:13:49,938 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 13, 49, 935808), True, datetime.datetime(2020, 7, 23, 7, 13, 49, 935808), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:13:49,949 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:13:49,950 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:13:49,950 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:13:59 UTC)" executed successfully builder stdout | 2020-07-23 07:13:50,499 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:13:50,772 [130] [DEBUG] [buildman.server] Writing metrics builder stdout | 2020-07-23 07:13:50,786 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds builder stdout | 2020-07-23 07:13:51,245 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:13:51,252 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:13:51,252 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:13:51,499 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 security_notification_worker stdout | 2020-07-23 07:13:52,447 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:13:52,448 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:00.351857+00:00 (in 7.904026 seconds) 2020-07-23 07:13:52,448 [101] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:14:52 UTC)" (scheduled at 2020-07-23 07:13:52.446816+00:00) 2020-07-23 07:13:52,448 [101] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:13:52,448 [101] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:14:52 UTC)" executed successfully builder stdout | 2020-07-23 07:13:52,499 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-registry stdout | 2020-07-23 07:13:52,547 [469] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '469'} gunicorn-registry stdout | 2020-07-23 07:13:52,569 [100] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '100'} gunicorn-registry stdout | 2020-07-23 07:13:52,599 [463] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '463'} gunicorn-registry stdout | 2020-07-23 07:13:52,605 [477] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '477'} gunicorn-registry stdout | 2020-07-23 07:13:52,611 [478] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '478'} gunicorn-registry stdout | 2020-07-23 07:13:52,620 [470] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '470'} gunicorn-registry stdout | 2020-07-23 07:13:52,633 [476] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '476'} gunicorn-registry stdout | 2020-07-23 07:13:52,637 [480] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '480'} gunicorn-registry stdout | 2020-07-23 07:13:52,659 [467] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '467'} gunicorn-registry stdout | 2020-07-23 07:13:52,671 [475] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '475'} gunicorn-registry stdout | 2020-07-23 07:13:52,686 [479] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '479'} gunicorn-registry stdout | 2020-07-23 07:13:52,696 [474] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '474'} gunicorn-registry stdout | 2020-07-23 07:13:52,700 [472] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '472'} gunicorn-registry stdout | 2020-07-23 07:13:52,713 [465] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '465'} gunicorn-registry stdout | 2020-07-23 07:13:52,718 [473] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '473'} gunicorn-registry stdout | 2020-07-23 07:13:52,725 [471] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '471'} gunicorn-registry stdout | 2020-07-23 07:13:52,731 [481] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '481'} builder stdout | 2020-07-23 07:13:53,500 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-verbs stdout | 2020-07-23 07:13:54,031 [127] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'verbs:application', 'pid': '127'} builder stdout | 2020-07-23 07:13:54,500 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:13:55,500 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 buildlogsarchiver stdout | 2020-07-23 07:13:56,396 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:13:56,397 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:26.395393+00:00 (in 29.998593 seconds) 2020-07-23 07:13:56,397 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:14:26 UTC)" (scheduled at 2020-07-23 07:13:56.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:13:56,399 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 13, 56, 397542), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:13:56,407 [109] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2020-07-23 07:13:56,407 [109] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:13:56,408 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:14:26 UTC)" executed successfully builder stdout | 2020-07-23 07:13:56,492 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 2020-07-23 07:13:56,493 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:13:55.500977 (running). builder stdout | 2020-07-23 07:13:56,501 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:13:57,500 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:13:58,292 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:13:58,293 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:14:08 UTC)" (scheduled at 2020-07-23 07:13:58.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:13:58,296 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) 2020-07-23 07:13:58,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:08.291018+00:00 (in 9.998632 seconds) repositoryactioncounter stdout | 2020-07-23 07:13:58,306 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:13:58,307 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:13:58,307 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:14:08 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:13:58,383 [419] [DEBUG] [app] Starting request: urn:request:e5f4041d-ef36-4daa-9d0e-db218bc59f82 (/health/instance) gunicorn-web stdout | 2020-07-23 07:13:58,386 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:13:58,392 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:13:58,394 [479] [DEBUG] [app] Starting request: urn:request:5dbec48d-ff54-4b14-9ee0-24b30da5b3d9 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:13:58,396 [479] [DEBUG] [app] Ending request: urn:request:5dbec48d-ff54-4b14-9ee0-24b30da5b3d9 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:13:58,397 [479] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:13:58,398 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:13:58,399 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:13:58,405 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:13:58,414 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:13:58,419 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:13:58,422 [436] [DEBUG] [app] Starting request: urn:request:6a002aaa-0f72-42f1-a230-361e1a0de452 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:58,423 [436] [DEBUG] [app] Ending request: urn:request:6a002aaa-0f72-42f1-a230-361e1a0de452 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:58,424 [436] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:58 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:58 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:13:58,424 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:13:58,428 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:58 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:13:58,429 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:13:58,432 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:13:58,434 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:58 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:13:58,438 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:13:58,439 [461] [DEBUG] [app] Starting request: urn:request:03efb7a3-39c0-4acd-9aea-fa7004f37d32 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:58 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:13:58,440 [461] [DEBUG] [app] Ending request: urn:request:03efb7a3-39c0-4acd-9aea-fa7004f37d32 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:58,441 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:13:58,441 [461] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:58 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:13:58,443 [419] [DEBUG] [app] Ending request: urn:request:e5f4041d-ef36-4daa-9d0e-db218bc59f82 (/health/instance) 2020-07-23 07:13:58,443 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:13:58,444 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:13:58 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:13:58 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.064 49 0.064) builder stdout | 2020-07-23 07:13:58,501 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:13:59,385 [419] [DEBUG] [app] Starting request: urn:request:f6887119-4fd2-4eea-a7e7-a31e1c694d57 (/health/instance) gunicorn-web stdout | 2020-07-23 07:13:59,388 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:13:59,390 [473] [DEBUG] [app] Starting request: urn:request:4e67c552-a461-4771-a3af-f86cd712828d (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:13:59,392 [473] [DEBUG] [app] Ending request: urn:request:4e67c552-a461-4771-a3af-f86cd712828d (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:13:59,393 [473] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:59 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:59 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:13:59,393 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:13:59,394 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:13:59,400 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:13:59,407 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:13:59,413 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:13:59,414 [419] [DEBUG] [app] Starting request: urn:request:e130e6c1-59d5-470e-805a-a8d76760876b (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:59,415 [419] [DEBUG] [app] Ending request: urn:request:e130e6c1-59d5-470e-805a-a8d76760876b (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:59 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:13:59,416 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:59 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:13:59,417 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:13:59,421 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:59 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:13:59,422 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:13:59,425 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:59 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:13:59,427 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:13:59,431 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:13:59,433 [461] [DEBUG] [app] Starting request: urn:request:a13e8815-f7c4-4cb9-8d99-467e89319751 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:13:59,434 [461] [DEBUG] [app] Ending request: urn:request:a13e8815-f7c4-4cb9-8d99-467e89319751 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:13:59,435 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:13:59 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:13:59,435 [461] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:13:59 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:13:59,437 [419] [DEBUG] [app] Ending request: urn:request:f6887119-4fd2-4eea-a7e7-a31e1c694d57 (/health/instance) 2020-07-23 07:13:59,438 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:13:59,439 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:13:59 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:13:59 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.056 49 0.056) builder stdout | 2020-07-23 07:13:59,501 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:13:59,913 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:13:59,914 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:09.911177+00:00 (in 9.997336 seconds) 2020-07-23 07:13:59,914 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:14:09 UTC)" (scheduled at 2020-07-23 07:13:59.911177+00:00) 2020-07-23 07:13:59,914 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:13:59,917 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 13, 59, 914832), True, datetime.datetime(2020, 7, 23, 7, 13, 59, 914832), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:13:59,927 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:13:59,927 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:13:59,928 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:14:09 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:14:00,352 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:14:00,353 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:30.351857+00:00 (in 29.998955 seconds) 2020-07-23 07:14:00,353 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:14:30 UTC)" (scheduled at 2020-07-23 07:14:00.351857+00:00) 2020-07-23 07:14:00,353 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:14:00,356 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 14, 0, 353912), True, datetime.datetime(2020, 7, 23, 7, 14, 0, 353912), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:14:00,365 [101] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:14:00,365 [101] [DEBUG] [data.database] Disconnecting from database. security_notification_worker stdout | 2020-07-23 07:14:00,365 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:14:30 UTC)" executed successfully builder stdout | 2020-07-23 07:14:00,501 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:14:01,254 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:14:01,279 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:14:01,280 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:14:01,502 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:14:02,502 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 securityworker stdout | 2020-07-23 07:14:03,477 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run securityworker stdout | 2020-07-23 07:14:03,477 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:33.476607+00:00 (in 29.998867 seconds) 2020-07-23 07:14:03,478 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:14:33 UTC)" (scheduled at 2020-07-23 07:14:03.476607+00:00) securityworker stdout | 2020-07-23 07:14:03,479 [128] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "image" AS "t1" WHERE ("t1"."security_indexed_engine" < %s)', [3]) securityworker stdout | 2020-07-23 07:14:03,487 [128] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "image" AS "t1"', []) securityworker stdout | 2020-07-23 07:14:03,488 [128] [DEBUG] [data.secscan_model.secscan_v2_model] Found no additional images to scan 2020-07-23 07:14:03,488 [128] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:14:03,489 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:14:33 UTC)" executed successfully builder stdout | 2020-07-23 07:14:03,502 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 exportactionlogsworker stdout | 2020-07-23 07:14:03,972 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:14:03,972 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:08.212267+00:00 (in 4.239687 seconds) 2020-07-23 07:14:03,973 [99] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:15:03 UTC)" (scheduled at 2020-07-23 07:14:03.971686+00:00) 2020-07-23 07:14:03,973 [99] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2020-07-23 07:14:03,976 [99] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 14, 3, 973803), True, datetime.datetime(2020, 7, 23, 7, 14, 3, 973803), 0, u'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2020-07-23 07:14:03,985 [99] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2020-07-23 07:14:03,985 [99] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:14:03,985 [99] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:15:03 UTC)" executed successfully builder stdout | 2020-07-23 07:14:04,502 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gcworker stdout | 2020-07-23 07:14:05,002 [110] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'gcworker.py', 'pid': '110'} expiredappspecifictokenworker stdout | 2020-07-23 07:14:05,400 [126] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '126'} builder stdout | 2020-07-23 07:14:05,503 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 securityworker stdout | 2020-07-23 07:14:06,032 [128] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'securityworker.py', 'pid': '128'} teamsyncworker stdout | 2020-07-23 07:14:06,352 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'teamsyncworker.py', 'pid': '115'} builder stdout | 2020-07-23 07:14:06,495 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 2020-07-23 07:14:06,495 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:14:05.503373 (running). builder stdout | 2020-07-23 07:14:06,503 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 namespacegcworker stdout | 2020-07-23 07:14:06,910 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:14:06,911 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:39.024941+00:00 (in 32.114053 seconds) 2020-07-23 07:14:06,911 [134] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:15:06 UTC)" (scheduled at 2020-07-23 07:14:06.910005+00:00) 2020-07-23 07:14:06,911 [134] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2020-07-23 07:14:06,914 [134] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 14, 6, 912014), True, datetime.datetime(2020, 7, 23, 7, 14, 6, 912014), 0, u'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2020-07-23 07:14:06,924 [134] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:14:06,924 [134] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2020-07-23 07:14:06,925 [134] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:15:06 UTC)" executed successfully builder stdout | 2020-07-23 07:14:07,503 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 exportactionlogsworker stdout | 2020-07-23 07:14:07,764 [99] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'exportactionlogsworker.py', 'pid': '99'} gunicorn-secscan stdout | 2020-07-23 07:14:07,968 [413] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '413'} gunicorn-secscan stdout | 2020-07-23 07:14:07,981 [412] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '412'} gunicorn-secscan stdout | 2020-07-23 07:14:08,002 [122] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '122'} gunicorn-secscan stdout | 2020-07-23 07:14:08,007 [411] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '411'} gunicorn-secscan stdout | 2020-07-23 07:14:08,013 [414] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '414'} queuecleanupworker stdout | 2020-07-23 07:14:08,181 [103] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'queuecleanupworker.py', 'pid': '103'} exportactionlogsworker stdout | 2020-07-23 07:14:08,213 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:14:08,214 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:03.971686+00:00 (in 55.757888 seconds) 2020-07-23 07:14:08,214 [99] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:15:08 UTC)" (scheduled at 2020-07-23 07:14:08.212267+00:00) 2020-07-23 07:14:08,214 [99] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:14:08,214 [99] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:15:08 UTC)" executed successfully repositoryactioncounter stdout | 2020-07-23 07:14:08,295 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:14:08,296 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:18.291018+00:00 (in 9.995181 seconds) 2020-07-23 07:14:08,296 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:14:18 UTC)" (scheduled at 2020-07-23 07:14:08.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:14:08,298 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:14:08,307 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:14:08,307 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:14:08,307 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:14:18 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:14:08,384 [438] [DEBUG] [app] Starting request: urn:request:d58d1f45-5a9c-4c79-aaea-5afcb6a157ec (/health/instance) gunicorn-web stdout | 2020-07-23 07:14:08,387 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:14:08,392 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:14:08,394 [481] [DEBUG] [app] Starting request: urn:request:876230a1-1018-451a-b829-ffb3563d3828 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:14:08,396 [481] [DEBUG] [app] Ending request: urn:request:876230a1-1018-451a-b829-ffb3563d3828 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:14:08,396 [481] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:08 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:08 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.006 162 0.006) gunicorn-web stdout | 2020-07-23 07:14:08,399 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:08,400 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:14:08,407 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:14:08,417 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:14:08,422 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:14:08,424 [438] [DEBUG] [app] Starting request: urn:request:9bc04a5d-e603-4e13-835d-cdd08cdfb51a (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:14:08,425 [438] [DEBUG] [app] Ending request: urn:request:9bc04a5d-e603-4e13-835d-cdd08cdfb51a (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:14:08,426 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:08 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:08 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:14:08,427 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:08,431 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:08 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:14:08,432 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:14:08,436 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:08 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:14:08,437 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:14:08,441 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:14:08,443 [461] [DEBUG] [app] Starting request: urn:request:95eb2b45-2b1a-45ae-b577-13d02bf6581d (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:14:08,445 [461] [DEBUG] [app] Ending request: urn:request:95eb2b45-2b1a-45ae-b577-13d02bf6581d (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:14:08,445 [461] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:08 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:08 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:14:08,446 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:08,448 [438] [DEBUG] [app] Ending request: urn:request:d58d1f45-5a9c-4c79-aaea-5afcb6a157ec (/health/instance) 2020-07-23 07:14:08,449 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:14:08,450 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:14:08 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:14:08 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.068 49 0.068) builder stdout | 2020-07-23 07:14:08,503 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 globalpromstats stdout | 2020-07-23 07:14:09,033 [129] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'globalpromstats.py', 'pid': '129'} gunicorn-web stdout | 2020-07-23 07:14:09,384 [419] [DEBUG] [app] Starting request: urn:request:98ccb05c-76e9-42dc-8fc1-04fbad2193dd (/health/instance) gunicorn-web stdout | 2020-07-23 07:14:09,387 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost buildlogsarchiver stdout | 2020-07-23 07:14:09,391 [109] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'buildlogsarchiver.py', 'pid': '109'} gunicorn-web stdout | 2020-07-23 07:14:09,393 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:14:09,395 [481] [DEBUG] [app] Starting request: urn:request:af222193-0c23-4ff7-85b2-ddd3a27724db (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:14:09,395 [481] [DEBUG] [app] Ending request: urn:request:af222193-0c23-4ff7-85b2-ddd3a27724db (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:14:09,396 [481] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:14:09,396 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:14:09,397 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:14:09,403 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:14:09,412 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:14:09,417 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:14:09,419 [419] [DEBUG] [app] Starting request: urn:request:3614b312-94c0-44a8-85e7-0252d46c6ca6 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:14:09,420 [419] [DEBUG] [app] Ending request: urn:request:3614b312-94c0-44a8-85e7-0252d46c6ca6 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:14:09,421 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:14:09,421 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:09,425 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:14:09,426 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:09 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:14:09,429 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:14:09,430 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:09 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:14:09,434 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:14:09,436 [461] [DEBUG] [app] Starting request: urn:request:91782254-639e-4e72-bca6-5369a25508e9 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:14:09,437 [461] [DEBUG] [app] Ending request: urn:request:91782254-639e-4e72-bca6-5369a25508e9 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:09 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:14:09,438 [461] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:09 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:14:09,438 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:09,440 [419] [DEBUG] [app] Ending request: urn:request:98ccb05c-76e9-42dc-8fc1-04fbad2193dd (/health/instance) 2020-07-23 07:14:09,440 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:14:09,441 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:14:09 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:14:09 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.059 49 0.059) builder stdout | 2020-07-23 07:14:09,504 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:14:09,631 [113] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'notificationworker.py', 'pid': '113'} chunkcleanupworker stdout | 2020-07-23 07:14:09,844 [124] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'chunkcleanupworker.py', 'pid': '124'} notificationworker stdout | 2020-07-23 07:14:09,912 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:14:09,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:11.998621+00:00 (in 2.086419 seconds) 2020-07-23 07:14:09,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:14:19 UTC)" (scheduled at 2020-07-23 07:14:09.911177+00:00) 2020-07-23 07:14:09,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:14:09,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 14, 9, 913105), True, datetime.datetime(2020, 7, 23, 7, 14, 9, 913105), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:14:09,924 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:14:09,925 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:14:09,925 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:14:19 UTC)" executed successfully gcworker stdout | 2020-07-23 07:14:10,005 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2020-07-23 07:14:10,006 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:40.004697+00:00 (in 29.998992 seconds) 2020-07-23 07:14:10,006 [110] [INFO] [apscheduler.executors.default] Running job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:14:40 UTC)" (scheduled at 2020-07-23 07:14:10.004697+00:00) gcworker stdout | 2020-07-23 07:14:10,007 [110] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1594278850006, 1209600, 500, 1, 0]) gcworker stdout | 2020-07-23 07:14:10,018 [110] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2020-07-23 07:14:10,018 [110] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:14:10,018 [110] [INFO] [apscheduler.executors.default] Job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:14:40 UTC)" executed successfully builder stdout | 2020-07-23 07:14:10,504 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:14:11,141 [130] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'builder.py', 'pid': '130'} builder stdout | 2020-07-23 07:14:11,282 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:14:11,299 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:14:11,300 [130] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2020-07-23 07:14:11,365 [134] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'namespacegcworker.py', 'pid': '134'} repositorygcworker stdout | 2020-07-23 07:14:11,373 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositorygcworker.py', 'pid': '102'} builder stdout | 2020-07-23 07:14:11,504 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 blobuploadcleanupworker stdout | 2020-07-23 07:14:11,826 [119] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'blobuploadcleanupworker.py', 'pid': '119'} notificationworker stdout | 2020-07-23 07:14:11,999 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:14:11,999 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:19.911177+00:00 (in 7.911697 seconds) 2020-07-23 07:14:12,000 [113] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:15:11 UTC)" (scheduled at 2020-07-23 07:14:11.998621+00:00) notificationworker stdout | 2020-07-23 07:14:12,000 [113] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:14:12,000 [113] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:15:11 UTC)" executed successfully builder stdout | 2020-07-23 07:14:12,504 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 security_notification_worker stdout | 2020-07-23 07:14:13,324 [101] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'security_notification_worker.py', 'pid': '101'} storagereplication stdout | 2020-07-23 07:14:13,371 [133] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'storagereplication.py', 'pid': '133'} logrotateworker stdout | 2020-07-23 07:14:13,386 [118] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'logrotateworker.py', 'pid': '118'} builder stdout | 2020-07-23 07:14:13,504 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:14:14,505 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:14:14,710 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositoryactioncounter.py', 'pid': '114'} servicekey stdout | 2020-07-23 07:14:15,365 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'servicekeyworker.py', 'pid': '98'} builder stdout | 2020-07-23 07:14:15,505 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:14:15,839 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '104'} gunicorn-web stdout | 2020-07-23 07:14:15,849 [435] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '435'} gunicorn-web stdout | 2020-07-23 07:14:15,860 [419] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '419'} gunicorn-web stdout | 2020-07-23 07:14:15,871 [438] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '438'} gunicorn-web stdout | 2020-07-23 07:14:15,879 [433] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '433'} gunicorn-web stdout | 2020-07-23 07:14:15,898 [431] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '431'} gunicorn-web stdout | 2020-07-23 07:14:15,911 [436] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '436'} gunicorn-web stdout | 2020-07-23 07:14:15,925 [420] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '420'} gunicorn-web stdout | 2020-07-23 07:14:15,929 [423] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '423'} builder stdout | 2020-07-23 07:14:16,498 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 2020-07-23 07:14:16,498 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:14:15.505678 (running). builder stdout | 2020-07-23 07:14:16,505 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:14:17,505 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:14:17,754 [436] [DEBUG] [app] Starting request: urn:request:08c9e6ca-9ef1-41bb-9c4f-a247c798c3b8 (/) gunicorn-web stdout | 2020-07-23 07:14:17,775 [436] [DEBUG] [endpoints.api.discovery] Unable to find method for POST in class gunicorn-web stdout | 2020-07-23 07:14:17,832 [436] [DEBUG] [app] Ending request: urn:request:08c9e6ca-9ef1-41bb-9c4f-a247c798c3b8 (/) gunicorn-web stdout | 2020-07-23 07:14:17,834 [436] [INFO] [gunicorn.access] 10.128.2.8 - - [23/Jul/2020:07:14:17 +0000] "GET / HTTP/1.0" 200 78881 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:17 +0000] "GET / HTTP/2.0" 200 12681 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.083 592 0.083) repositoryactioncounter stdout | 2020-07-23 07:14:18,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:14:18,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:28.291018+00:00 (in 9.999076 seconds) 2020-07-23 07:14:18,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:14:28 UTC)" (scheduled at 2020-07-23 07:14:18.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:14:18,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:14:18,304 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:14:18,304 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:14:18,305 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:14:28 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:14:18,383 [419] [DEBUG] [app] Starting request: urn:request:7665e40e-45bb-464a-87e3-120a0ebe31ca (/health/instance) gunicorn-web stdout | 2020-07-23 07:14:18,386 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:14:18,391 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:14:18,393 [463] [DEBUG] [app] Starting request: urn:request:3f38e4a8-8c68-4694-981d-3541d5610f16 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:14:18,394 [463] [DEBUG] [app] Ending request: urn:request:3f38e4a8-8c68-4694-981d-3541d5610f16 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:18 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-registry stdout | 2020-07-23 07:14:18,395 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:18 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:14:18,396 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:18,397 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:14:18,402 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:14:18,411 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:14:18,416 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:14:18,418 [419] [DEBUG] [app] Starting request: urn:request:32cf9006-d8c7-4ae7-ba35-edd3bdbe28b0 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:14:18,419 [419] [DEBUG] [app] Ending request: urn:request:32cf9006-d8c7-4ae7-ba35-edd3bdbe28b0 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:18 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:14:18,420 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:18 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:14:18,421 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:18,424 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:18 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:14:18,425 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:14:18,428 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:18 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:14:18,429 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:14:18,433 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:14:18,435 [468] [DEBUG] [app] Starting request: urn:request:4c48336f-d3a3-40bf-8256-1089e3d7417a (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:14:18,436 [468] [DEBUG] [app] Ending request: urn:request:4c48336f-d3a3-40bf-8256-1089e3d7417a (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:18 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:14:18,437 [468] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:18 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:14:18,437 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:18,439 [419] [DEBUG] [app] Ending request: urn:request:7665e40e-45bb-464a-87e3-120a0ebe31ca (/health/instance) 2020-07-23 07:14:18,439 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:14:18,440 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:14:18 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:14:18 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.059 49 0.059) builder stdout | 2020-07-23 07:14:18,506 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:19 +0000] "GET /static/ldn/font-awesome.css-a166e3c966c6.css HTTP/2.0" 200 8404 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 292 -) nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:19 +0000] "GET /static/ldn/bootstrap.min.css-13f668494557.css HTTP/2.0" 200 24427 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 48 -) nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:19 +0000] "GET /static/ldn/cssfamilySourceSansPro300400700-30cd793a4b9b.css HTTP/2.0" 200 271 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 58 -) nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:19 +0000] "GET /static/ldn/core-icons.css-d500848fee49.css HTTP/2.0" 200 702 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 46 -) nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:19 +0000] "GET /static/ldn/bootstrap-datetimepicker.min.css-4b15a4ede750.css HTTP/2.0" 200 1470 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 58 -) 10.128.2.8 () - - [23/Jul/2020:07:14:19 +0000] "GET /static/ldn/cal-heatmap.css-904c3b9e8a60.css HTTP/2.0" 200 787 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 47 -) nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:19 +0000] "GET /static/ldn/ng-tags-input.min.css-7782190f81cd.css HTTP/2.0" 200 1067 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 51 -) nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:19 +0000] "GET /static/img/RedHat.svg HTTP/2.0" 200 1233 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 45 -) nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:19 +0000] "GET /static/ldn/jquery.js-3c5c5966471e.js HTTP/2.0" 200 102774 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 48 -) nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:19 +0000] "GET /static/ldn/bootstrap.min.js-0e773844b374.js HTTP/2.0" 200 11290 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 48 -) nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:19 +0000] "GET /static/ldn/angular.min.js-f0f4228b82f7.js HTTP/2.0" 200 63479 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 46 -) nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:19 +0000] "GET /static/ldn/angular-route.min.js-590b72b0eb88.js HTTP/2.0" 200 2236 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 50 -) 10.128.2.8 () - - [23/Jul/2020:07:14:19 +0000] "GET /static/ldn/angular-sanitize.min.js-ff589de0ec1b.js HTTP/2.0" 200 3116 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 52 -) nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:19 +0000] "GET /static/ldn/angular-animate.min.js-636f7a51b2e1.js HTTP/2.0" 200 10296 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.014 52 -) 10.128.2.8 () - - [23/Jul/2020:07:14:19 +0000] "GET /static/ldn/angular-cookies.min.js-2455ea25d522.js HTTP/2.0" 200 814 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.014 51 -) 10.128.2.8 () - - [23/Jul/2020:07:14:19 +0000] "GET /static/ldn/momentjs-66a52705d33f.js HTTP/2.0" 200 19464 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.014 42 -) 10.128.2.8 () - - [23/Jul/2020:07:14:19 +0000] "GET /static/ldn/bootstrap-datepicker.min.js-3e3d8e141d5e.js HTTP/2.0" 200 9310 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.014 55 -) 10.128.2.8 () - - [23/Jul/2020:07:14:19 +0000] "GET /static/ldn/bootstrap-datetimepicker.min.js-6612bb423b71.js HTTP/2.0" 200 10819 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.014 58 -) 10.128.2.8 () - - [23/Jul/2020:07:14:19 +0000] "GET /static/ldn/bootbox4.1.0underscorejs1.5.2restangular1.2.0d3js3.3.3-6d47ddfef9c5.js HTTP/2.0" 200 71170 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.014 74 -) 10.128.2.8 () - - [23/Jul/2020:07:14:19 +0000] "GET /static/ldn/raven.min.js-ecd480647a39.js HTTP/2.0" 200 9492 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.014 45 -) 10.128.2.8 () - - [23/Jul/2020:07:14:19 +0000] "GET /static/ldn/cal-heatmap.min.js-8ffad728269a.js HTTP/2.0" 200 12991 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.014 49 -) 10.128.2.8 () - - [23/Jul/2020:07:14:19 +0000] "GET /static/ldn/angular-recaptcha.min.js-23859fca3602.js HTTP/2.0" 200 1781 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 53 -) 10.128.2.8 () - - [23/Jul/2020:07:14:19 +0000] "GET /static/ldn/ng-tags-input.min.js-fa3026ba8409.js HTTP/2.0" 200 6089 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 50 -) nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:19 +0000] "GET /static/ldn/typeahead.bundle.min.js-716151ca4e5d.js HTTP/2.0" 200 16660 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 52 -) gunicorn-web stdout | 2020-07-23 07:14:19,385 [438] [DEBUG] [app] Starting request: urn:request:f5e700f9-54ef-4c0d-93f0-b5eab4aa142d (/health/instance) gunicorn-web stdout | 2020-07-23 07:14:19,387 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:14:19,392 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:14:19,394 [463] [DEBUG] [app] Starting request: urn:request:8d5f29e5-63b0-4d99-9123-f4352b298cdd (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:14:19,396 [463] [DEBUG] [app] Ending request: urn:request:8d5f29e5-63b0-4d99-9123-f4352b298cdd (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:19 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-registry stdout | 2020-07-23 07:14:19,397 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:19 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:14:19,397 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:19,398 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:14:19,406 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:14:19,414 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:14:19,419 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:14:19,422 [436] [DEBUG] [app] Starting request: urn:request:ef017472-a2cd-4e66-887e-c3c1e4af6d99 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:14:19,423 [436] [DEBUG] [app] Ending request: urn:request:ef017472-a2cd-4e66-887e-c3c1e4af6d99 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:14:19,424 [436] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:19 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:19 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:14:19,424 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:19,428 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:19 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:14:19,429 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:14:19,432 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:14:19,433 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:19 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:14:19,438 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:14:19,439 [461] [DEBUG] [app] Starting request: urn:request:5432a098-1a4f-4611-b487-9c1650f49059 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:14:19,441 [461] [DEBUG] [app] Ending request: urn:request:5432a098-1a4f-4611-b487-9c1650f49059 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:19 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:14:19,441 [461] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:19 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:14:19,441 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:19,444 [438] [DEBUG] [app] Ending request: urn:request:f5e700f9-54ef-4c0d-93f0-b5eab4aa142d (/health/instance) gunicorn-web stdout | 2020-07-23 07:14:19,444 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:14:19,445 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:14:19 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:14:19 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.061 49 0.061) builder stdout | 2020-07-23 07:14:19,506 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:14:19,912 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:14:19,913 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:29.911177+00:00 (in 9.998486 seconds) 2020-07-23 07:14:19,913 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:14:29 UTC)" (scheduled at 2020-07-23 07:14:19.911177+00:00) 2020-07-23 07:14:19,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:14:19,916 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 14, 19, 913870), True, datetime.datetime(2020, 7, 23, 7, 14, 19, 913870), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:14:19,926 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:14:19,927 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:14:19,927 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:14:29 UTC)" executed successfully builder stdout | 2020-07-23 07:14:20,506 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:20 +0000] "GET /static/standalonelib/jquery.overscroll.min.js HTTP/2.0" 200 3479 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (1.245 49 -) nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:20 +0000] "GET /static/build/main-quay-frontend-99f053388ff176834686.bundle.js HTTP/2.0" 200 698715 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (1.399 62 -) builder stdout | 2020-07-23 07:14:20,788 [130] [DEBUG] [buildman.server] Writing metrics builder stdout | 2020-07-23 07:14:20,803 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds builder stdout | 2020-07-23 07:14:21,301 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:14:21,308 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:14:21,308 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:14:21,507 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositorygcworker stdout | 2020-07-23 07:14:21,739 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:14:21,740 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:28.907644+00:00 (in 7.167517 seconds) 2020-07-23 07:14:21,740 [102] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:15:21 UTC)" (scheduled at 2020-07-23 07:14:21.739118+00:00) 2020-07-23 07:14:21,740 [102] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2020-07-23 07:14:21,742 [102] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 14, 21, 741043), True, datetime.datetime(2020, 7, 23, 7, 14, 21, 741043), 0, u'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2020-07-23 07:14:21,751 [102] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:14:21,751 [102] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:14:21,751 [102] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:15:21 UTC)" executed successfully builder stdout | 2020-07-23 07:14:22,507 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-registry stdout | 2020-07-23 07:14:22,558 [469] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '469'} gunicorn-registry stdout | 2020-07-23 07:14:22,581 [100] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '100'} gunicorn-registry stdout | 2020-07-23 07:14:22,613 [463] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '463'} gunicorn-registry stdout | 2020-07-23 07:14:22,617 [477] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '477'} gunicorn-registry stdout | 2020-07-23 07:14:22,629 [478] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '478'} gunicorn-registry stdout | 2020-07-23 07:14:22,634 [470] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '470'} gunicorn-registry stdout | 2020-07-23 07:14:22,650 [476] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '476'} gunicorn-registry stdout | 2020-07-23 07:14:22,657 [480] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '480'} gunicorn-registry stdout | 2020-07-23 07:14:22,671 [467] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '467'} gunicorn-registry stdout | 2020-07-23 07:14:22,683 [475] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '475'} gunicorn-registry stdout | 2020-07-23 07:14:22,700 [479] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '479'} gunicorn-registry stdout | 2020-07-23 07:14:22,711 [474] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '474'} gunicorn-registry stdout | 2020-07-23 07:14:22,716 [472] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '472'} gunicorn-registry stdout | 2020-07-23 07:14:22,727 [465] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '465'} gunicorn-registry stdout | 2020-07-23 07:14:22,733 [473] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '473'} gunicorn-registry stdout | 2020-07-23 07:14:22,740 [471] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '471'} gunicorn-registry stdout | 2020-07-23 07:14:22,748 [481] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '481'} builder stdout | 2020-07-23 07:14:23,507 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-verbs stdout | 2020-07-23 07:14:24,139 [127] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'verbs:application', 'pid': '127'} builder stdout | 2020-07-23 07:14:24,507 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:14:25,507 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 buildlogsarchiver stdout | 2020-07-23 07:14:26,396 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:14:26,396 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:56.395393+00:00 (in 29.999086 seconds) 2020-07-23 07:14:26,396 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:14:56 UTC)" (scheduled at 2020-07-23 07:14:26.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:14:26,398 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 14, 26, 397042), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:14:26,406 [109] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2020-07-23 07:14:26,406 [109] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:14:26,407 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:14:56 UTC)" executed successfully builder stdout | 2020-07-23 07:14:26,500 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:14:26,500 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:14:25.507986 (running). builder stdout | 2020-07-23 07:14:26,507 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:14:27,508 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:14:28,292 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:14:28,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:38.291018+00:00 (in 9.998705 seconds) repositoryactioncounter stdout | 2020-07-23 07:14:28,293 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:14:38 UTC)" (scheduled at 2020-07-23 07:14:28.291018+00:00) 2020-07-23 07:14:28,296 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:14:28,305 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:14:28,305 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:14:28,306 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:14:38 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:14:28,382 [435] [DEBUG] [app] Starting request: urn:request:38fbe845-772e-4b26-9fa8-b916a511d13a (/health/instance) gunicorn-web stdout | 2020-07-23 07:14:28,385 [435] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:14:28,391 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:14:28,393 [472] [DEBUG] [app] Starting request: urn:request:a174f403-ace5-4115-ad1c-0be23ddf9a53 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:14:28,394 [472] [DEBUG] [app] Ending request: urn:request:a174f403-ace5-4115-ad1c-0be23ddf9a53 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:14:28,395 [472] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:28 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:28 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:14:28,395 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:28,397 [435] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:14:28,402 [435] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:14:28,410 [435] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:14:28,416 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:14:28,418 [435] [DEBUG] [app] Starting request: urn:request:12403dae-2bbb-4246-8305-d13bde2aa535 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:14:28,419 [435] [DEBUG] [app] Ending request: urn:request:12403dae-2bbb-4246-8305-d13bde2aa535 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:14:28,420 [435] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:28 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:14:28,420 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:28 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:14:28,424 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:28 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:14:28,425 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:14:28,428 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:14:28,430 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:28 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:14:28,433 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:14:28,435 [461] [DEBUG] [app] Starting request: urn:request:4cc5e8ed-512d-42e2-a649-5ac078644870 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:14:28,436 [461] [DEBUG] [app] Ending request: urn:request:4cc5e8ed-512d-42e2-a649-5ac078644870 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:14:28,437 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:28 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:14:28,436 [461] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:28 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:14:28,439 [435] [DEBUG] [app] Ending request: urn:request:38fbe845-772e-4b26-9fa8-b916a511d13a (/health/instance) gunicorn-web stdout | 2020-07-23 07:14:28,439 [435] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:14:28,440 [435] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:14:28 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:14:28 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.058 49 0.058) builder stdout | 2020-07-23 07:14:28,508 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositorygcworker stdout | 2020-07-23 07:14:28,908 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:14:28,909 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:21.739118+00:00 (in 52.830445 seconds) 2020-07-23 07:14:28,909 [102] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:15:28 UTC)" (scheduled at 2020-07-23 07:14:28.907644+00:00) 2020-07-23 07:14:28,909 [102] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:14:28,909 [102] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:15:28 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:14:29,384 [419] [DEBUG] [app] Starting request: urn:request:1e4ff6a6-34e2-43e0-8d2c-b59912e2d84d (/health/instance) gunicorn-web stdout | 2020-07-23 07:14:29,387 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:14:29,394 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:14:29,395 [463] [DEBUG] [app] Starting request: urn:request:b84df726-6682-4768-ad80-4dbc0d84585e (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:14:29,396 [463] [DEBUG] [app] Ending request: urn:request:b84df726-6682-4768-ad80-4dbc0d84585e (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:14:29,397 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:29 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:14:29,397 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:29 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:14:29,398 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:14:29,405 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:14:29,412 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:14:29,417 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:14:29,419 [438] [DEBUG] [app] Starting request: urn:request:46ff7c67-8176-4477-8e70-50f029fc7131 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:14:29,420 [438] [DEBUG] [app] Ending request: urn:request:46ff7c67-8176-4477-8e70-50f029fc7131 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:14:29,421 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:29 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:29 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:14:29,422 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:29,426 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:14:29,427 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:29 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:14:29,431 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:29 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:14:29,432 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:14:29,436 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:14:29,438 [464] [DEBUG] [app] Starting request: urn:request:e83705df-a12a-461d-b0e2-d6553750eac5 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:14:29,439 [464] [DEBUG] [app] Ending request: urn:request:e83705df-a12a-461d-b0e2-d6553750eac5 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:29 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:14:29,440 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:14:29,440 [464] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:29 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:14:29,443 [419] [DEBUG] [app] Ending request: urn:request:1e4ff6a6-34e2-43e0-8d2c-b59912e2d84d (/health/instance) gunicorn-web stdout | 2020-07-23 07:14:29,443 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:14:29,444 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:14:29 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:14:29 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.061 49 0.061) builder stdout | 2020-07-23 07:14:29,508 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:14:29,912 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:14:29,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:14:39 UTC)" (scheduled at 2020-07-23 07:14:29.911177+00:00) 2020-07-23 07:14:29,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:14:29,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 14, 29, 913351), True, datetime.datetime(2020, 7, 23, 7, 14, 29, 913351), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:14:29,915 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:39.911177+00:00 (in 9.998837 seconds) notificationworker stdout | 2020-07-23 07:14:29,925 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:14:29,925 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:14:29,925 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:14:39 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:14:30,352 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:14:30,353 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:50.446184+00:00 (in 20.093292 seconds) 2020-07-23 07:14:30,353 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:15:00 UTC)" (scheduled at 2020-07-23 07:14:30.351857+00:00) 2020-07-23 07:14:30,353 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:14:30,356 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 14, 30, 353950), True, datetime.datetime(2020, 7, 23, 7, 14, 30, 353950), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:14:30,366 [101] [DEBUG] [workers.queueworker] No more work. security_notification_worker stdout | 2020-07-23 07:14:30,366 [101] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:14:30,366 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:15:00 UTC)" executed successfully builder stdout | 2020-07-23 07:14:30,509 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:14:31,309 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:14:31,323 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:14:31,323 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:14:31,509 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:32 +0000] "GET /static/img/quay_favicon.png HTTP/2.0" 200 3558 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 35 -) builder stdout | 2020-07-23 07:14:32,509 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 securityworker stdout | 2020-07-23 07:14:33,477 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run securityworker stdout | 2020-07-23 07:14:33,477 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:03.476607+00:00 (in 29.999113 seconds) 2020-07-23 07:14:33,478 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:15:03 UTC)" (scheduled at 2020-07-23 07:14:33.476607+00:00) securityworker stdout | 2020-07-23 07:14:33,478 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:15:03 UTC)" executed successfully builder stdout | 2020-07-23 07:14:33,509 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:14:34,510 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gcworker stdout | 2020-07-23 07:14:35,042 [110] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'gcworker.py', 'pid': '110'} expiredappspecifictokenworker stdout | 2020-07-23 07:14:35,435 [126] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '126'} builder stdout | 2020-07-23 07:14:35,510 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 securityworker stdout | 2020-07-23 07:14:36,075 [128] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'securityworker.py', 'pid': '128'} teamsyncworker stdout | 2020-07-23 07:14:36,391 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'teamsyncworker.py', 'pid': '115'} builder stdout | 2020-07-23 07:14:36,502 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:14:36,503 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:14:35.510342 (running). builder stdout | 2020-07-23 07:14:36,510 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:14:37,510 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 exportactionlogsworker stdout | 2020-07-23 07:14:37,797 [99] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'exportactionlogsworker.py', 'pid': '99'} gunicorn-secscan stdout | 2020-07-23 07:14:37,978 [413] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '413'} gunicorn-secscan stdout | 2020-07-23 07:14:37,992 [412] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '412'} gunicorn-secscan stdout | 2020-07-23 07:14:38,014 [122] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '122'} gunicorn-secscan stdout | 2020-07-23 07:14:38,018 [411] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '411'} gunicorn-secscan stdout | 2020-07-23 07:14:38,024 [414] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '414'} queuecleanupworker stdout | 2020-07-23 07:14:38,222 [103] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'queuecleanupworker.py', 'pid': '103'} repositoryactioncounter stdout | 2020-07-23 07:14:38,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:14:38,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:48.291018+00:00 (in 9.999061 seconds) 2020-07-23 07:14:38,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:14:48 UTC)" (scheduled at 2020-07-23 07:14:38.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:14:38,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:14:38,303 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:14:38,303 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:14:38,303 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:14:48 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:14:38,382 [438] [DEBUG] [app] Starting request: urn:request:dd8f680b-982e-403a-bf83-3e111f7d0a2a (/health/instance) gunicorn-web stdout | 2020-07-23 07:14:38,385 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:14:38,391 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:14:38,393 [471] [DEBUG] [app] Starting request: urn:request:bb9e1e57-e80f-4550-99df-5c152f493335 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:14:38,394 [471] [DEBUG] [app] Ending request: urn:request:bb9e1e57-e80f-4550-99df-5c152f493335 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:14:38,395 [471] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:38 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:38 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.005 162 0.005) gunicorn-web stdout | 2020-07-23 07:14:38,397 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:38,398 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:14:38,403 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) builder stdout | 2020-07-23 07:14:38,648 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:14:38,649 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:14:38,658 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:14:38,662 [419] [DEBUG] [app] Starting request: urn:request:4d6e7509-c796-4d63-a972-141d519ae3bb (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:14:38,663 [419] [DEBUG] [app] Ending request: urn:request:4d6e7509-c796-4d63-a972-141d519ae3bb (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:14:38,664 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:38 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:38 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.005 159 0.005) gunicorn-web stdout | 2020-07-23 07:14:38,668 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:38,673 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:38 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:14:38,674 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:14:38,677 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:38 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:14:38,679 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:14:38,683 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:14:38,685 [464] [DEBUG] [app] Starting request: urn:request:25519ea8-3ea6-4989-8c98-76c8346a5ca0 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:14:38,686 [464] [DEBUG] [app] Ending request: urn:request:25519ea8-3ea6-4989-8c98-76c8346a5ca0 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:38 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:14:38,687 [464] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:38 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:14:38,688 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:38,690 [438] [DEBUG] [app] Ending request: urn:request:dd8f680b-982e-403a-bf83-3e111f7d0a2a (/health/instance) 2020-07-23 07:14:38,690 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:14:38,691 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:14:38 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:14:38 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.310 49 0.310) namespacegcworker stdout | 2020-07-23 07:14:39,026 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:14:39,026 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:06.910005+00:00 (in 27.883579 seconds) 2020-07-23 07:14:39,027 [134] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:15:39 UTC)" (scheduled at 2020-07-23 07:14:39.024941+00:00) 2020-07-23 07:14:39,027 [134] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:14:39,027 [134] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:15:39 UTC)" executed successfully globalpromstats stdout | 2020-07-23 07:14:39,073 [129] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'globalpromstats.py', 'pid': '129'} gunicorn-web stdout | 2020-07-23 07:14:39,384 [436] [DEBUG] [app] Starting request: urn:request:db7788f2-7ac4-4d5d-b7d5-9f99c60a15cd (/health/instance) gunicorn-web stdout | 2020-07-23 07:14:39,387 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:14:39,392 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:14:39,394 [471] [DEBUG] [app] Starting request: urn:request:bcac6a4c-c451-49d4-be72-78e3b933919a (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:14:39,395 [471] [DEBUG] [app] Ending request: urn:request:bcac6a4c-c451-49d4-be72-78e3b933919a (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:14:39,396 [471] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.006 162 0.006) gunicorn-web stdout | 2020-07-23 07:14:39,398 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:39,399 [436] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:14:39,406 [436] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:14:39,414 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:14:39,420 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:14:39,421 [436] [DEBUG] [app] Starting request: urn:request:e8c8bc9c-fc6f-461b-bf3e-2ea7894ade09 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:14:39,422 [436] [DEBUG] [app] Ending request: urn:request:e8c8bc9c-fc6f-461b-bf3e-2ea7894ade09 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:14:39,423 [436] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:14:39,423 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:39,427 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:39 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:14:39,428 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:14:39,432 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:14:39,437 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 buildlogsarchiver stdout | 2020-07-23 07:14:39,436 [109] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'buildlogsarchiver.py', 'pid': '109'} nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:39 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:14:39,442 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:14:39,444 [466] [DEBUG] [app] Starting request: urn:request:3ccc89d3-8e04-4c98-89e8-3c5a5ea57cd6 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:14:39,445 [466] [DEBUG] [app] Ending request: urn:request:3ccc89d3-8e04-4c98-89e8-3c5a5ea57cd6 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:14:39,446 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:39 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:39 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:14:39,447 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:39,449 [436] [DEBUG] [app] Ending request: urn:request:db7788f2-7ac4-4d5d-b7d5-9f99c60a15cd (/health/instance) gunicorn-web stdout | 2020-07-23 07:14:39,449 [436] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:14:39,450 [436] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:14:39 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:14:39 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.067 49 0.067) builder stdout | 2020-07-23 07:14:39,511 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:14:39,663 [113] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'notificationworker.py', 'pid': '113'} chunkcleanupworker stdout | 2020-07-23 07:14:39,882 [124] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'chunkcleanupworker.py', 'pid': '124'} notificationworker stdout | 2020-07-23 07:14:39,915 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:14:39,915 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:49.911177+00:00 (in 9.995836 seconds) 2020-07-23 07:14:39,916 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:14:49 UTC)" (scheduled at 2020-07-23 07:14:39.911177+00:00) 2020-07-23 07:14:39,916 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:14:39,918 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 14, 39, 916547), True, datetime.datetime(2020, 7, 23, 7, 14, 39, 916547), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:14:39,928 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:14:39,928 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:14:39,928 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:14:49 UTC)" executed successfully gcworker stdout | 2020-07-23 07:14:40,005 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2020-07-23 07:14:40,005 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:10.004697+00:00 (in 29.999060 seconds) 2020-07-23 07:14:40,006 [110] [INFO] [apscheduler.executors.default] Running job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:15:10 UTC)" (scheduled at 2020-07-23 07:14:40.004697+00:00) gcworker stdout | 2020-07-23 07:14:40,008 [110] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1594278880006, 1209600, 500, 1, 0]) gcworker stdout | 2020-07-23 07:14:40,019 [110] [DEBUG] [__main__] No repository with garbage found 2020-07-23 07:14:40,019 [110] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2020-07-23 07:14:40,019 [110] [INFO] [apscheduler.executors.default] Job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:15:10 UTC)" executed successfully builder stdout | 2020-07-23 07:14:40,511 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:14:41,172 [130] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'builder.py', 'pid': '130'} builder stdout | 2020-07-23 07:14:41,325 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:14:41,338 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:14:41,338 [130] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2020-07-23 07:14:41,401 [134] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'namespacegcworker.py', 'pid': '134'} repositorygcworker stdout | 2020-07-23 07:14:41,412 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositorygcworker.py', 'pid': '102'} builder stdout | 2020-07-23 07:14:41,511 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 blobuploadcleanupworker stdout | 2020-07-23 07:14:41,876 [119] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'blobuploadcleanupworker.py', 'pid': '119'} builder stdout | 2020-07-23 07:14:42,512 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 security_notification_worker stdout | 2020-07-23 07:14:43,363 [101] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'security_notification_worker.py', 'pid': '101'} storagereplication stdout | 2020-07-23 07:14:43,398 [133] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'storagereplication.py', 'pid': '133'} logrotateworker stdout | 2020-07-23 07:14:43,419 [118] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'logrotateworker.py', 'pid': '118'} builder stdout | 2020-07-23 07:14:43,512 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:14:44,512 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:14:44,750 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositoryactioncounter.py', 'pid': '114'} servicekey stdout | 2020-07-23 07:14:45,403 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'servicekeyworker.py', 'pid': '98'} builder stdout | 2020-07-23 07:14:45,512 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:14:45,850 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '104'} gunicorn-web stdout | 2020-07-23 07:14:45,859 [435] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '435'} gunicorn-web stdout | 2020-07-23 07:14:45,879 [419] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '419'} gunicorn-web stdout | 2020-07-23 07:14:45,885 [438] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '438'} gunicorn-web stdout | 2020-07-23 07:14:45,891 [433] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '433'} gunicorn-web stdout | 2020-07-23 07:14:45,910 [431] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '431'} gunicorn-web stdout | 2020-07-23 07:14:45,921 [436] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '436'} gunicorn-web stdout | 2020-07-23 07:14:45,936 [420] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '420'} gunicorn-web stdout | 2020-07-23 07:14:45,940 [423] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '423'} builder stdout | 2020-07-23 07:14:46,504 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 2020-07-23 07:14:46,505 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:14:45.512897 (running). builder stdout | 2020-07-23 07:14:46,512 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:47 +0000] "GET /static/build/79-quay-frontend.chunk.js HTTP/2.0" 200 1449 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 45 -) nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:47 +0000] "GET /static/build/128-quay-frontend.chunk.js HTTP/2.0" 200 904 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 45 -) nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:47 +0000] "GET /static/build/16-quay-frontend.chunk.js HTTP/2.0" 200 978 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 44 -) 10.128.2.8 () - - [23/Jul/2020:07:14:47 +0000] "GET /static/build/108-quay-frontend.chunk.js HTTP/2.0" 200 756 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 45 -) nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:47 +0000] "GET /static/build/172-quay-frontend.chunk.js HTTP/2.0" 200 682 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 45 -) nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:47 +0000] "GET /static/build/143-quay-frontend.chunk.js HTTP/2.0" 200 312 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 45 -) nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:47 +0000] "GET /static/img/network-tile.png HTTP/2.0" 200 6289 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 36 -) builder stdout | 2020-07-23 07:14:47,513 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:14:47,639 [438] [DEBUG] [app] Starting request: urn:request:9495b77d-9233-4701-a316-bcd4a89f1314 (/api/v1/user/) gunicorn-web stdout | 2020-07-23 07:14:47,643 [438] [DEBUG] [app] Ending request: urn:request:9495b77d-9233-4701-a316-bcd4a89f1314 (/api/v1/user/) nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:47 +0000] "GET /api/v1/user/ HTTP/2.0" 401 313 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.008 143 0.008) gunicorn-web stdout | 2020-07-23 07:14:47,645 [438] [INFO] [gunicorn.access] 10.128.2.8 - - [23/Jul/2020:07:14:47 +0000] "GET /api/v1/user/ HTTP/1.0" 401 313 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" gunicorn-web stdout | 2020-07-23 07:14:47,680 [419] [DEBUG] [app] Starting request: urn:request:7d9bdbbf-84c7-4d65-83e4-a6541b14e73e (/api/v1/messages) gunicorn-web stdout | 2020-07-23 07:14:47,682 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."content", "t1"."uuid", "t1"."severity", "t1"."media_type_id", "t2"."id", "t2"."name" FROM "messages" AS "t1" INNER JOIN "mediatype" AS "t2" ON ("t1"."media_type_id" = "t2"."id")', []) gunicorn-web stdout | 2020-07-23 07:14:47,692 [419] [DEBUG] [app] Ending request: urn:request:7d9bdbbf-84c7-4d65-83e4-a6541b14e73e (/api/v1/messages) gunicorn-web stdout | 2020-07-23 07:14:47,693 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:14:47,694 [419] [INFO] [gunicorn.access] 10.128.2.8 - - [23/Jul/2020:07:14:47 +0000] "GET /api/v1/messages HTTP/1.0" 200 17 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:47 +0000] "GET /api/v1/messages HTTP/2.0" 200 17 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.017 29 0.017) nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:47 +0000] "GET /static/img/RH_Logo_Quay_Black_UX-horizontal.svg HTTP/2.0" 200 3210 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 52 -) nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:47 +0000] "GET /static/fonts/fontawesome-webfont.woff2?v=4.7.0 HTTP/2.0" 200 77160 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/static/ldn/font-awesome.css-a166e3c966c6.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 386 -) repositoryactioncounter stdout | 2020-07-23 07:14:48,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:14:48,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:58.291018+00:00 (in 9.999077 seconds) 2020-07-23 07:14:48,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:14:58 UTC)" (scheduled at 2020-07-23 07:14:48.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:14:48,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:14:48,303 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:14:48,304 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:14:48,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:14:58 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:14:48,383 [436] [DEBUG] [app] Starting request: urn:request:d615706e-7f46-4aac-92b5-3ce3be6f3193 (/health/instance) gunicorn-web stdout | 2020-07-23 07:14:48,386 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:14:48,391 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:14:48,392 [473] [DEBUG] [app] Starting request: urn:request:08dd6d5a-539a-4cc2-ba76-acf8ec3df7ad (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:14:48,393 [473] [DEBUG] [app] Ending request: urn:request:08dd6d5a-539a-4cc2-ba76-acf8ec3df7ad (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:14:48,394 [473] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:14:48,395 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:48,396 [436] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:14:48,402 [436] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:14:48,410 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:14:48,415 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:14:48,417 [436] [DEBUG] [app] Starting request: urn:request:0908e5e1-3673-472b-bf5b-3e4a12f3c90c (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:14:48,418 [436] [DEBUG] [app] Ending request: urn:request:0908e5e1-3673-472b-bf5b-3e4a12f3c90c (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:48 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 159 0.002) gunicorn-web stdout | 2020-07-23 07:14:48,418 [436] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:48 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:14:48,419 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:48,422 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:14:48,423 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:48 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:14:48,426 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:48 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:14:48,427 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:14:48,431 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:14:48,433 [462] [DEBUG] [app] Starting request: urn:request:039e427d-6cf8-4c94-95e1-18083c50a5a7 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:14:48,434 [462] [DEBUG] [app] Ending request: urn:request:039e427d-6cf8-4c94-95e1-18083c50a5a7 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:48 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:14:48,435 [462] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:48 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:14:48,435 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:48,437 [436] [DEBUG] [app] Ending request: urn:request:d615706e-7f46-4aac-92b5-3ce3be6f3193 (/health/instance) gunicorn-web stdout | 2020-07-23 07:14:48,437 [436] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:14:48,438 [436] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:14:48 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:14:48 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.057 49 0.057) builder stdout | 2020-07-23 07:14:48,513 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:14:49,385 [419] [DEBUG] [app] Starting request: urn:request:f1efc49e-9e5e-40cc-abc3-90fcaee33bc0 (/health/instance) gunicorn-web stdout | 2020-07-23 07:14:49,387 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:14:49,393 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:14:49,395 [481] [DEBUG] [app] Starting request: urn:request:fa3235ea-f17c-4cf5-ab06-65085f9ba28e (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:14:49,397 [481] [DEBUG] [app] Ending request: urn:request:fa3235ea-f17c-4cf5-ab06-65085f9ba28e (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:14:49,397 [481] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:49 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:49 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:14:49,398 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:49,399 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:14:49,404 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:14:49,412 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:14:49,417 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:14:49,419 [419] [DEBUG] [app] Starting request: urn:request:43f8cade-a09c-4aae-9ef9-f10c9fe3791f (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:14:49,420 [419] [DEBUG] [app] Ending request: urn:request:43f8cade-a09c-4aae-9ef9-f10c9fe3791f (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:14:49,421 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:49 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:49 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:14:49,421 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:49,425 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:49 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:14:49,426 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:14:49,430 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:14:49,431 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:49 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:14:49,436 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:14:49,437 [461] [DEBUG] [app] Starting request: urn:request:c9a7cfcb-90a3-4619-8057-c249197bcf3d (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:14:49,438 [461] [DEBUG] [app] Ending request: urn:request:c9a7cfcb-90a3-4619-8057-c249197bcf3d (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:14:49,439 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:49 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 162 0.002) gunicorn-verbs stdout | 2020-07-23 07:14:49,439 [461] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:49 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:14:49,440 [419] [DEBUG] [app] Ending request: urn:request:f1efc49e-9e5e-40cc-abc3-90fcaee33bc0 (/health/instance) 2020-07-23 07:14:49,441 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:14:49,441 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:14:49 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:14:49 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.058 49 0.058) builder stdout | 2020-07-23 07:14:49,513 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:14:49,912 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:14:49,913 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:59.911177+00:00 (in 9.998394 seconds) notificationworker stdout | 2020-07-23 07:14:49,913 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:14:59 UTC)" (scheduled at 2020-07-23 07:14:49.911177+00:00) notificationworker stdout | 2020-07-23 07:14:49,915 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:14:49,919 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 14, 49, 916060), True, datetime.datetime(2020, 7, 23, 7, 14, 49, 916060), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:14:49,928 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:14:49,929 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:14:49,929 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:14:59 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:14:50,446 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:14:50,447 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:14:52.446816+00:00 (in 1.999595 seconds) 2020-07-23 07:14:50,448 [101] [INFO] [apscheduler.executors.default] Running job "update_queue_metrics (trigger: interval[0:05:00], next run at: 2020-07-23 07:19:50 UTC)" (scheduled at 2020-07-23 07:14:50.446184+00:00) security_notification_worker stdout | 2020-07-23 07:14:50,449 [101] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2020, 7, 23, 7, 14, 50, 448305), u'security_notification/%']) security_notification_worker stdout | 2020-07-23 07:14:50,457 [101] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2020, 7, 23, 7, 14, 50, 448305), True, datetime.datetime(2020, 7, 23, 7, 14, 50, 448305), 0, u'security_notification/%']) security_notification_worker stdout | 2020-07-23 07:14:50,461 [101] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2020, 7, 23, 7, 14, 50, 448305), True, datetime.datetime(2020, 7, 23, 7, 14, 50, 448305), 0, u'security_notification/%', False, datetime.datetime(2020, 7, 23, 7, 14, 50, 448305), u'security_notification/%']) security_notification_worker stdout | 2020-07-23 07:14:50,463 [101] [DEBUG] [data.database] Disconnecting from database. security_notification_worker stdout | 2020-07-23 07:14:50,463 [101] [INFO] [apscheduler.executors.default] Job "update_queue_metrics (trigger: interval[0:05:00], next run at: 2020-07-23 07:19:50 UTC)" executed successfully builder stdout | 2020-07-23 07:14:50,513 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:14:50,804 [130] [DEBUG] [buildman.server] Writing metrics builder stdout | 2020-07-23 07:14:50,819 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds builder stdout | 2020-07-23 07:14:51,339 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:14:51,345 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:14:51,345 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:14:51,514 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 security_notification_worker stdout | 2020-07-23 07:14:52,449 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:14:52,450 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:00.351857+00:00 (in 7.901605 seconds) 2020-07-23 07:14:52,450 [101] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:15:52 UTC)" (scheduled at 2020-07-23 07:14:52.446816+00:00) 2020-07-23 07:14:52,451 [101] [DEBUG] [workers.queueworker] Running watchdog. security_notification_worker stdout | 2020-07-23 07:14:52,451 [101] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:15:52 UTC)" executed successfully builder stdout | 2020-07-23 07:14:52,514 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-registry stdout | 2020-07-23 07:14:52,570 [469] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '469'} gunicorn-registry stdout | 2020-07-23 07:14:52,594 [100] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '100'} gunicorn-registry stdout | 2020-07-23 07:14:52,624 [463] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '463'} gunicorn-registry stdout | 2020-07-23 07:14:52,631 [477] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '477'} gunicorn-registry stdout | 2020-07-23 07:14:52,643 [478] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '478'} gunicorn-registry stdout | 2020-07-23 07:14:52,647 [470] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '470'} gunicorn-registry stdout | 2020-07-23 07:14:52,665 [476] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '476'} gunicorn-registry stdout | 2020-07-23 07:14:52,672 [480] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '480'} gunicorn-registry stdout | 2020-07-23 07:14:52,684 [467] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '467'} gunicorn-registry stdout | 2020-07-23 07:14:52,695 [475] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '475'} gunicorn-registry stdout | 2020-07-23 07:14:52,713 [479] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '479'} gunicorn-registry stdout | 2020-07-23 07:14:52,727 [474] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '474'} gunicorn-registry stdout | 2020-07-23 07:14:52,738 [472] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '472'} gunicorn-registry stdout | 2020-07-23 07:14:52,745 [465] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '465'} gunicorn-registry stdout | 2020-07-23 07:14:52,748 [473] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '473'} gunicorn-registry stdout | 2020-07-23 07:14:52,755 [471] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '471'} gunicorn-registry stdout | 2020-07-23 07:14:52,766 [481] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '481'} builder stdout | 2020-07-23 07:14:53,514 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-verbs stdout | 2020-07-23 07:14:54,252 [127] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'verbs:application', 'pid': '127'} gunicorn-web stdout | 2020-07-23 07:14:54,334 [438] [DEBUG] [app] Starting request: urn:request:880edfb3-e086-483b-bc81-7ab29e2e40b7 (/api/v1/signin) gunicorn-web stdout | 2020-07-23 07:14:54,340 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) OR ("t1"."email" = %s)) LIMIT %s OFFSET %s', [u'quay', u'quay', 1, 0]) builder stdout | 2020-07-23 07:14:54,514 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:14:54,662 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', [u'5b657e28-1928-415c-af1d-d7717a61299c', False, 1, 0]) gunicorn-web stdout | 2020-07-23 07:14:54,667 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', [u'5b657e28-1928-415c-af1d-d7717a61299c', False, 1, 0]) gunicorn-web stdout | 2020-07-23 07:14:54,670 [438] [DEBUG] [endpoints.common] Successfully signed in as user quay with uuid 5b657e28-1928-415c-af1d-d7717a61299c gunicorn-web stdout | 2020-07-23 07:14:54,670 [438] [DEBUG] [auth.permissions] Identity loaded: gunicorn-web stdout | 2020-07-23 07:14:54,671 [438] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c gunicorn-web stdout | 2020-07-23 07:14:54,674 [438] [DEBUG] [app] Ending request: urn:request:880edfb3-e086-483b-bc81-7ab29e2e40b7 (/api/v1/signin) gunicorn-web stdout | 2020-07-23 07:14:54,676 [438] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:14:54,677 [438] [INFO] [gunicorn.access] 10.128.2.8 - - [23/Jul/2020:07:14:54 +0000] "POST /api/v1/signin HTTP/1.0" 200 18 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:54 +0000] "POST /api/v1/signin HTTP/2.0" 200 18 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.344 96 0.344) gunicorn-web stdout | 2020-07-23 07:14:54,912 [433] [DEBUG] [app] Starting request: urn:request:70363cbc-fc34-4287-a64f-c3d607b14afc (/api/v1/user/) gunicorn-web stdout | 2020-07-23 07:14:54,912 [433] [DEBUG] [app] User loader loading deferred user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:14:54,913 [433] [DEBUG] [auth.cookie] Loading user from cookie: 5b657e28-1928-415c-af1d-d7717a61299c gunicorn-web stdout | 2020-07-23 07:14:54,916 [433] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', [u'5b657e28-1928-415c-af1d-d7717a61299c', False, 1, 0]) gunicorn-web stdout | 2020-07-23 07:14:54,927 [433] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [None, None, None, None, , None]) gunicorn-web stdout | 2020-07-23 07:14:54,928 [433] [DEBUG] [auth.permissions] Identity loaded: 2020-07-23 07:14:54,928 [433] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:14:54,928 [433] [DEBUG] [auth.permissions] Loading user permissions after deferring for: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:14:54,928 [433] [DEBUG] [auth.permissions] User permission: userspecificneed(type='user', username=u'quay', role='admin') gunicorn-web stdout | 2020-07-23 07:14:54,929 [433] [DEBUG] [auth.permissions] User namespace permission: namespacewide(type='organization', namespace=u'quay', role='admin') 2020-07-23 07:14:54,929 [433] [DEBUG] [auth.permissions] User namespace repo permission: namespacewide(type='organizationrepo', namespace=u'quay', role='admin') 2020-07-23 07:14:54,929 [433] [DEBUG] [auth.permissions] Adding superuser to user: quay gunicorn-web stdout | 2020-07-23 07:14:54,931 [433] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" INNER JOIN "team" AS "t2" ON ("t2"."organization_id" = "t1"."id") INNER JOIN "teammember" AS "t3" ON ("t3"."team_id" = "t2"."id") INNER JOIN "user" AS "t4" ON ("t4"."id" = "t3"."user_id") WHERE (("t1"."organization" = %s) AND ("t4"."username" = %s))', [True, u'quay']) gunicorn-web stdout | 2020-07-23 07:14:54,935 [433] [DEBUG] [auth.permissions] Loading user permissions after deferring for: 5b657e28-1928-415c-af1d-d7717a61299c gunicorn-web stdout | 2020-07-23 07:14:54,936 [433] [DEBUG] [peewee] ('SELECT "t1"."service_ident", "t2"."name", "t1"."metadata_json" FROM "federatedlogin" AS "t1" INNER JOIN "loginservice" AS "t2" ON ("t1"."service_id" = "t2"."id") WHERE (("t2"."name" != %s) AND ("t1"."user_id" = %s))', [u'quayrobot', 1]) gunicorn-web stdout | 2020-07-23 07:14:54,939 [433] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."kind_id" FROM "userprompt" AS "t1" INNER JOIN "userpromptkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE ("t1"."user_id" = %s)', [1]) gunicorn-web stdout | 2020-07-23 07:14:54,941 [433] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', [u'quay', False, 1, 0]) gunicorn-web stdout | 2020-07-23 07:14:54,943 [433] [DEBUG] [auth.permissions] Loading user permissions after deferring for: 5b657e28-1928-415c-af1d-d7717a61299c gunicorn-web stdout | 2020-07-23 07:14:54,943 [433] [DEBUG] [auth.permissions] Loading user permissions after deferring for: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:14:54,943 [433] [DEBUG] [auth.permissions] Loading user permissions after deferring for: 5b657e28-1928-415c-af1d-d7717a61299c gunicorn-web stdout | 2020-07-23 07:14:54,946 [433] [DEBUG] [app] Ending request: urn:request:70363cbc-fc34-4287-a64f-c3d607b14afc (/api/v1/user/) gunicorn-web stdout | 2020-07-23 07:14:54,948 [433] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:14:54,949 [433] [INFO] [gunicorn.access] 10.128.2.8 - - [23/Jul/2020:07:14:54 +0000] "GET /api/v1/user/ HTTP/1.0" 200 551 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:54 +0000] "GET /api/v1/user/ HTTP/2.0" 200 551 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.040 504 0.040) gunicorn-web stdout | 2020-07-23 07:14:55,289 [419] [DEBUG] [app] Starting request: urn:request:79036169-e49a-4993-bdbe-02c96b3b9b39 (/api/v1/user/notifications) gunicorn-web stdout | 2020-07-23 07:14:55,290 [419] [DEBUG] [app] User loader loading deferred user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:14:55,291 [419] [DEBUG] [auth.cookie] Loading user from cookie: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:14:55,291 [436] [DEBUG] [app] Starting request: urn:request:6a33e620-7c88-4cbb-b2a7-643ac3d93b74 (/api/v1/user/apptoken) gunicorn-web stdout | 2020-07-23 07:14:55,291 [436] [DEBUG] [app] User loader loading deferred user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c gunicorn-web stdout | 2020-07-23 07:14:55,292 [436] [DEBUG] [auth.cookie] Loading user from cookie: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:14:55,293 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', [u'5b657e28-1928-415c-af1d-d7717a61299c', False, 1, 0]) gunicorn-web stdout | 2020-07-23 07:14:55,295 [436] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', [u'5b657e28-1928-415c-af1d-d7717a61299c', False, 1, 0]) gunicorn-web stdout | 2020-07-23 07:14:55,301 [419] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [None, None, None, None, , None]) gunicorn-web stdout | 2020-07-23 07:14:55,302 [419] [DEBUG] [auth.permissions] Identity loaded: 2020-07-23 07:14:55,303 [419] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:14:55,303 [419] [DEBUG] [endpoints.api] Checking permission for user quay 2020-07-23 07:14:55,303 [419] [DEBUG] [auth.permissions] Loading user permissions after deferring for: 5b657e28-1928-415c-af1d-d7717a61299c gunicorn-web stdout | 2020-07-23 07:14:55,303 [419] [DEBUG] [auth.permissions] User permission: userspecificneed(type='user', username=u'quay', role='admin') 2020-07-23 07:14:55,303 [419] [DEBUG] [auth.permissions] User namespace permission: namespacewide(type='organization', namespace=u'quay', role='admin') 2020-07-23 07:14:55,303 [419] [DEBUG] [auth.permissions] User namespace repo permission: namespacewide(type='organizationrepo', namespace=u'quay', role='admin') 2020-07-23 07:14:55,304 [419] [DEBUG] [auth.permissions] Adding superuser to user: quay gunicorn-web stdout | 2020-07-23 07:14:55,304 [436] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [None, None, None, None, , None]) gunicorn-web stdout | 2020-07-23 07:14:55,305 [436] [DEBUG] [auth.permissions] Identity loaded: 2020-07-23 07:14:55,305 [436] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c gunicorn-web stdout | 2020-07-23 07:14:55,306 [436] [DEBUG] [endpoints.api] Checking permission for user quay 2020-07-23 07:14:55,306 [436] [DEBUG] [auth.permissions] Loading user permissions after deferring for: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:14:55,306 [436] [DEBUG] [auth.permissions] User permission: userspecificneed(type='user', username=u'quay', role='admin') gunicorn-web stdout | 2020-07-23 07:14:55,306 [436] [DEBUG] [auth.permissions] User namespace permission: namespacewide(type='organization', namespace=u'quay', role='admin') 2020-07-23 07:14:55,306 [436] [DEBUG] [auth.permissions] User namespace repo permission: namespacewide(type='organizationrepo', namespace=u'quay', role='admin') 2020-07-23 07:14:55,306 [436] [DEBUG] [auth.permissions] Adding superuser to user: quay gunicorn-web stdout | 2020-07-23 07:14:55,308 [436] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2020, 7, 26, 2, 26, 55, 307420), datetime.datetime(2020, 7, 23, 7, 14, 55, 307617)]) gunicorn-web stdout | 2020-07-23 07:14:55,309 [419] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, u'admin', 6]) gunicorn-web stdout | 2020-07-23 07:14:55,314 [436] [DEBUG] [app] Ending request: urn:request:6a33e620-7c88-4cbb-b2a7-643ac3d93b74 (/api/v1/user/apptoken) gunicorn-web stdout | 2020-07-23 07:14:55,315 [436] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:14:55,316 [436] [INFO] [gunicorn.access] 10.128.2.8 - - [23/Jul/2020:07:14:55 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:55 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/2.0" 200 38 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.029 60 0.029) gunicorn-web stdout | 2020-07-23 07:14:55,317 [419] [DEBUG] [app] Ending request: urn:request:79036169-e49a-4993-bdbe-02c96b3b9b39 (/api/v1/user/notifications) gunicorn-web stdout | 2020-07-23 07:14:55,319 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:14:55,320 [419] [INFO] [gunicorn.access] 10.128.2.8 - - [23/Jul/2020:07:14:55 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:55 +0000] "GET /api/v1/user/notifications HTTP/2.0" 200 43 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.033 52 0.033) gunicorn-web stdout | 2020-07-23 07:14:55,476 [419] [DEBUG] [app] Starting request: urn:request:a27c8d59-9c11-44b9-b9e8-9efafd480856 (/api/v1/repository) 2020-07-23 07:14:55,476 [423] [DEBUG] [app] Starting request: urn:request:4be7137a-032e-4786-b675-0ba67f10b6bf (/api/v1/repository) gunicorn-web stdout | 2020-07-23 07:14:55,477 [419] [DEBUG] [app] User loader loading deferred user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:14:55,477 [419] [DEBUG] [auth.cookie] Loading user from cookie: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:14:55,477 [423] [DEBUG] [app] User loader loading deferred user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c gunicorn-web stdout | 2020-07-23 07:14:55,478 [423] [DEBUG] [auth.cookie] Loading user from cookie: 5b657e28-1928-415c-af1d-d7717a61299c gunicorn-web stdout | 2020-07-23 07:14:55,480 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', [u'5b657e28-1928-415c-af1d-d7717a61299c', False, 1, 0]) 2020-07-23 07:14:55,480 [423] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', [u'5b657e28-1928-415c-af1d-d7717a61299c', False, 1, 0]) gunicorn-web stdout | 2020-07-23 07:14:55,489 [419] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [None, None, None, None, , None]) 2020-07-23 07:14:55,490 [419] [DEBUG] [auth.permissions] Identity loaded: 2020-07-23 07:14:55,490 [419] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:14:55,489 [423] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [None, None, None, None, , None]) 2020-07-23 07:14:55,491 [423] [DEBUG] [auth.permissions] Identity loaded: 2020-07-23 07:14:55,491 [423] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c gunicorn-web stdout | 2020-07-23 07:14:55,491 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', []) gunicorn-web stdout | 2020-07-23 07:14:55,495 [423] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', [u'quay', 1, 0]) gunicorn-web stdout | 2020-07-23 07:14:55,497 [423] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', []) 2020-07-23 07:14:55,497 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name", "t1"."id" AS "rid" FROM "repository" AS "t1" INNER JOIN "star" AS "t4" ON ("t4"."repository_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE ((("t4"."user_id" = %s) AND ("t1"."kind_id" = %s)) AND ("t1"."state" != %s))', [1, 1, 3]) gunicorn-web stdout | 2020-07-23 07:14:55,501 [423] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1"', []) gunicorn-web stdout | 2020-07-23 07:14:55,504 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name", "t1"."id" AS "rid" FROM "repository" AS "t1" INNER JOIN "star" AS "t4" ON ("t4"."repository_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE ((("t4"."user_id" = %s) AND ("t1"."kind_id" = %s)) AND ("t1"."state" != %s))', [1, 1, 3]) gunicorn-web stdout | 2020-07-23 07:14:55,506 [423] [DEBUG] [peewee] ('((SELECT DISTINCT "t1"."name", "t1"."id" AS "rid", "t1"."description", "t2"."username", "t1"."visibility_id", "t1"."kind_id" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") LEFT OUTER JOIN "repositorypermission" AS "t3" ON ("t3"."repository_id" = "t1"."id") WHERE (((("t1"."state" != %s) AND ("t1"."kind_id" = %s)) AND ("t2"."username" = %s)) AND ("t3"."user_id" = %s))) UNION (SELECT DISTINCT "t4"."name", "t4"."id" AS "rid", "t4"."description", "t5"."username", "t4"."visibility_id", "t4"."kind_id" FROM "repository" AS "t4" INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "repositorypermission" AS "t6" ON ("t6"."repository_id" = "t4"."id") INNER JOIN "team" AS "t7" ON ("t6"."team_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t8"."team_id" = "t7"."id") WHERE (((("t4"."state" != %s) AND ("t4"."kind_id" = %s)) AND ("t5"."username" = %s)) AND ("t8"."user_id" = %s)))) UNION (SELECT DISTINCT "t4"."name", "t4"."id" AS "rid", "t4"."description", "t5"."username", "t4"."visibility_id", "t4"."kind_id" FROM "repository" AS "t4" INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "repositorypermission" AS "t6" ON ("t6"."repository_id" = "t4"."id") INNER JOIN "team" AS "t9" ON ("t9"."organization_id" = "t4"."namespace_user_id") INNER JOIN "teammember" AS "t10" ON ("t9"."id" = "t10"."team_id") WHERE ((((("t4"."state" != %s) AND ("t4"."kind_id" = %s)) AND ("t5"."username" = %s)) AND ("t9"."role_id" = %s)) AND ("t10"."user_id" = %s)))', [3, 1, u'quay', 1, 3, 1, u'quay', 1, 3, 1, u'quay', 1, 1]) gunicorn-web stdout | 2020-07-23 07:14:55,508 [419] [DEBUG] [app] Ending request: urn:request:a27c8d59-9c11-44b9-b9e8-9efafd480856 (/api/v1/repository) gunicorn-web stdout | 2020-07-23 07:14:55,509 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:14:55,510 [419] [INFO] [gunicorn.access] 10.128.2.8 - - [23/Jul/2020:07:14:55 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.0" 200 21 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/repository/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:55 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/2.0" 200 21 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/repository/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.037 159 0.037) builder stdout | 2020-07-23 07:14:55,514 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:14:55,517 [423] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name", "t1"."id" AS "rid" FROM "repository" AS "t1" INNER JOIN "star" AS "t4" ON ("t4"."repository_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE ((("t4"."user_id" = %s) AND ("t1"."kind_id" = %s)) AND ("t1"."state" != %s))', [1, 1, 3]) gunicorn-web stdout | 2020-07-23 07:14:55,521 [423] [DEBUG] [app] Ending request: urn:request:4be7137a-032e-4786-b675-0ba67f10b6bf (/api/v1/repository) gunicorn-web stdout | 2020-07-23 07:14:55,523 [423] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:14:55,524 [423] [INFO] [gunicorn.access] 10.128.2.8 - - [23/Jul/2020:07:14:55 +0000] "GET /api/v1/repository?last_modified=true&namespace=quay&popularity=true HTTP/1.0" 200 21 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/repository/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:55 +0000] "GET /api/v1/repository?last_modified=true&namespace=quay&popularity=true HTTP/2.0" 200 21 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/repository/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.050 83 0.050) buildlogsarchiver stdout | 2020-07-23 07:14:56,396 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:14:56,396 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:26.395393+00:00 (in 29.999091 seconds) 2020-07-23 07:14:56,397 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:15:26 UTC)" (scheduled at 2020-07-23 07:14:56.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:14:56,398 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 14, 56, 397281), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:14:56,407 [109] [DEBUG] [__main__] No more builds to archive 2020-07-23 07:14:56,408 [109] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2020-07-23 07:14:56,408 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:15:26 UTC)" executed successfully builder stdout | 2020-07-23 07:14:56,507 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:14:56,507 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:14:55.515095 (running). builder stdout | 2020-07-23 07:14:56,515 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:14:57,515 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:14:58 +0000] "GET /static/fonts/glyphicons-halflings-regular.woff2 HTTP/2.0" 200 18028 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/static/ldn/bootstrap.min.css-13f668494557.css" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 606 -) repositoryactioncounter stdout | 2020-07-23 07:14:58,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:14:58,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:08.291018+00:00 (in 9.998789 seconds) repositoryactioncounter stdout | 2020-07-23 07:14:58,293 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:15:08 UTC)" (scheduled at 2020-07-23 07:14:58.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:14:58,296 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:14:58,305 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:14:58,305 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:14:58,306 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:15:08 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:14:58,383 [436] [DEBUG] [app] Starting request: urn:request:5754a811-3981-492d-af31-63426f0438c9 (/health/instance) gunicorn-web stdout | 2020-07-23 07:14:58,386 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:14:58,391 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:14:58,393 [475] [DEBUG] [app] Starting request: urn:request:42e7ed81-7856-4798-b42b-cf5053ce011b (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:14:58,394 [475] [DEBUG] [app] Ending request: urn:request:42e7ed81-7856-4798-b42b-cf5053ce011b (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-registry stdout | 2020-07-23 07:14:58,395 [475] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:14:58,395 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:58,396 [436] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:14:58,402 [436] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:14:58,411 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:14:58,416 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:14:58,418 [436] [DEBUG] [app] Starting request: urn:request:ebb09e8f-9fb4-426c-944b-cd593bbf32f5 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:14:58,419 [436] [DEBUG] [app] Ending request: urn:request:ebb09e8f-9fb4-426c-944b-cd593bbf32f5 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:58 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:14:58,420 [436] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:58 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:14:58,421 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:58,425 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:58 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:14:58,426 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:14:58,429 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:58 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:14:58,431 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:14:58,435 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:14:58,437 [468] [DEBUG] [app] Starting request: urn:request:4386497c-718a-4fc0-b6c0-e166ab7bbec0 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:14:58,438 [468] [DEBUG] [app] Ending request: urn:request:4386497c-718a-4fc0-b6c0-e166ab7bbec0 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:58 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:14:58,439 [468] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:58 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:14:58,439 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:58,441 [436] [DEBUG] [app] Ending request: urn:request:5754a811-3981-492d-af31-63426f0438c9 (/health/instance) 2020-07-23 07:14:58,441 [436] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:14:58,442 [436] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:14:58 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:14:58 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.061 49 0.061) builder stdout | 2020-07-23 07:14:58,516 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:14:59,384 [433] [DEBUG] [app] Starting request: urn:request:f38bf349-008b-454b-a7f5-1e096f53b8c2 (/health/instance) gunicorn-web stdout | 2020-07-23 07:14:59,387 [433] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:14:59,392 [433] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:14:59,394 [463] [DEBUG] [app] Starting request: urn:request:fd6ae46d-b313-4373-9ef3-3d9776c19e9b (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:14:59,395 [463] [DEBUG] [app] Ending request: urn:request:fd6ae46d-b313-4373-9ef3-3d9776c19e9b (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:59 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-registry stdout | 2020-07-23 07:14:59,396 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:59 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:14:59,396 [433] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:59,397 [433] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:14:59,403 [433] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:14:59,411 [433] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:14:59,416 [433] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:14:59,418 [433] [DEBUG] [app] Starting request: urn:request:7efe4a3c-e1fe-4a0a-ae29-abf2482d1cb5 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:14:59,419 [433] [DEBUG] [app] Ending request: urn:request:7efe4a3c-e1fe-4a0a-ae29-abf2482d1cb5 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:59 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 159 0.002) gunicorn-web stdout | 2020-07-23 07:14:59,420 [433] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:59 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:14:59,420 [433] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:59,424 [433] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:59 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:14:59,424 [433] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:14:59,427 [433] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:14:59,428 [433] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:59 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:14:59,432 [433] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:14:59,433 [466] [DEBUG] [app] Starting request: urn:request:03a03946-5e61-4844-acb8-fb5c6f82a361 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:14:59,434 [466] [DEBUG] [app] Ending request: urn:request:03a03946-5e61-4844-acb8-fb5c6f82a361 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:14:59 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:14:59,435 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:14:59 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:14:59,435 [433] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:14:59,437 [433] [DEBUG] [app] Ending request: urn:request:f38bf349-008b-454b-a7f5-1e096f53b8c2 (/health/instance) 2020-07-23 07:14:59,437 [433] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:14:59,438 [433] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:14:59 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:14:59 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.056 49 0.056) builder stdout | 2020-07-23 07:14:59,516 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:14:59,914 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:14:59,914 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:06.997992+00:00 (in 7.083443 seconds) 2020-07-23 07:14:59,915 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:15:09 UTC)" (scheduled at 2020-07-23 07:14:59.911177+00:00) 2020-07-23 07:14:59,915 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:14:59,917 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 14, 59, 915619), True, datetime.datetime(2020, 7, 23, 7, 14, 59, 915619), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:14:59,928 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:14:59,928 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:14:59,929 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:15:09 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:15:00,352 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:15:00,353 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:30.351857+00:00 (in 29.999059 seconds) 2020-07-23 07:15:00,353 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:15:30 UTC)" (scheduled at 2020-07-23 07:15:00.351857+00:00) 2020-07-23 07:15:00,353 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:15:00,356 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 15, 0, 353918), True, datetime.datetime(2020, 7, 23, 7, 15, 0, 353918), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:15:00,365 [101] [DEBUG] [workers.queueworker] No more work. security_notification_worker stdout | 2020-07-23 07:15:00,365 [101] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:15:00,365 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:15:30 UTC)" executed successfully builder stdout | 2020-07-23 07:15:00,516 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:15:01,347 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:15:01,358 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:15:01,359 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:15:01,516 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:15:02,257 [433] [DEBUG] [app] Starting request: urn:request:d21c6032-9ba2-4268-93c4-e4fe5c947bd8 (/api/v1/repository) gunicorn-web stdout | 2020-07-23 07:15:02,258 [433] [DEBUG] [app] User loader loading deferred user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:15:02,258 [433] [DEBUG] [auth.cookie] Loading user from cookie: 5b657e28-1928-415c-af1d-d7717a61299c gunicorn-web stdout | 2020-07-23 07:15:02,260 [433] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', [u'5b657e28-1928-415c-af1d-d7717a61299c', False, 1, 0]) gunicorn-web stdout | 2020-07-23 07:15:02,268 [433] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [None, None, None, None, , None]) gunicorn-web stdout | 2020-07-23 07:15:02,268 [433] [DEBUG] [auth.permissions] Identity loaded: 2020-07-23 07:15:02,268 [433] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c gunicorn-web stdout | 2020-07-23 07:15:02,272 [433] [DEBUG] [auth.permissions] Loading user permissions after deferring for: 5b657e28-1928-415c-af1d-d7717a61299c gunicorn-web stdout | 2020-07-23 07:15:02,273 [433] [DEBUG] [auth.permissions] User permission: userspecificneed(type='user', username=u'quay', role='admin') 2020-07-23 07:15:02,273 [433] [DEBUG] [auth.permissions] User namespace permission: namespacewide(type='organization', namespace=u'quay', role='admin') 2020-07-23 07:15:02,273 [433] [DEBUG] [auth.permissions] User namespace repo permission: namespacewide(type='organizationrepo', namespace=u'quay', role='admin') 2020-07-23 07:15:02,273 [433] [DEBUG] [auth.permissions] Adding superuser to user: quay gunicorn-web stdout | 2020-07-23 07:15:02,277 [433] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', [u'quay', u'demo', 3, 1, 0]) gunicorn-web stdout | 2020-07-23 07:15:02,282 [433] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', [u'quay', 1, 0]) gunicorn-web stdout | 2020-07-23 07:15:02,286 [433] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', [u'quay', u'demo', 3, 1, 0]) gunicorn-web stdout | 2020-07-23 07:15:02,289 [433] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1"', []) gunicorn-web stdout | 2020-07-23 07:15:02,291 [433] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', []) gunicorn-web stdout | 2020-07-23 07:15:02,293 [433] [DEBUG] [peewee] ('INSERT INTO "repository" ("namespace_user_id", "name", "visibility_id", "description", "badge_token", "kind_id", "trust_enabled", "state") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "repository"."id"', [1, u'demo', 2, u'', u'8e65ec30-9379-4f0c-94e5-71dc219efd24', 1, False, 0]) gunicorn-web stdout | 2020-07-23 07:15:02,297 [433] [DEBUG] [peewee] ('INSERT INTO "repositoryactioncount" ("repository_id", "count", "date") VALUES (%s, %s, %s) RETURNING "repositoryactioncount"."id"', [1, 0, datetime.date(2020, 7, 22)]) gunicorn-web stdout | 2020-07-23 07:15:02,299 [433] [DEBUG] [peewee] ('INSERT INTO "repositorysearchscore" ("repository_id", "score") VALUES (%s, %s) RETURNING "repositorysearchscore"."id"', [1, 0]) gunicorn-web stdout | 2020-07-23 07:15:02,301 [433] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "role" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', [u'admin', 1, 0]) gunicorn-web stdout | 2020-07-23 07:15:02,305 [433] [DEBUG] [peewee] ('INSERT INTO "repositorypermission" ("user_id", "repository_id", "role_id") VALUES (%s, %s, %s) RETURNING "repositorypermission"."id"', [1, 1, 1]) gunicorn-web stdout | 2020-07-23 07:15:02,310 [433] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', [u'quay', u'demo', 3, 1, 0]) gunicorn-web stdout | 2020-07-23 07:15:02,314 [433] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', [u'quay', 1, 0]) gunicorn-web stdout | 2020-07-23 07:15:02,316 [433] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "logentrykind" AS "t1"', []) gunicorn-web stdout | 2020-07-23 07:15:02,323 [433] [DEBUG] [peewee] ('INSERT INTO "logentry3" ("kind_id", "account_id", "performer_id", "repository_id", "datetime", "ip", "metadata_json") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "logentry3"."id"', [14, 1, 1, 1, datetime.datetime(2020, 7, 23, 7, 15, 2, 313276), u'10.128.2.8', u'{"repo": "demo", "namespace": "quay"}']) gunicorn-web stdout | 2020-07-23 07:15:02,328 [433] [DEBUG] [app] Ending request: urn:request:d21c6032-9ba2-4268-93c4-e4fe5c947bd8 (/api/v1/repository) gunicorn-web stdout | 2020-07-23 07:15:02,329 [433] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:15:02,330 [433] [INFO] [gunicorn.access] 10.128.2.8 - - [23/Jul/2020:07:15:02 +0000] "POST /api/v1/repository HTTP/1.0" 201 55 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/new/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:15:02 +0000] "POST /api/v1/repository HTTP/2.0" 201 55 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/new/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.075 715 0.075) builder stdout | 2020-07-23 07:15:02,516 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:15:02,677 [419] [DEBUG] [app] Starting request: urn:request:c5a355ec-5560-47d3-a469-610396f77d45 (/api/v1/repository/quay/demo/tag/) gunicorn-web stdout | 2020-07-23 07:15:02,677 [438] [DEBUG] [app] Starting request: urn:request:3479eb3c-4840-44a2-852a-d30b1a4ede77 (/api/v1/repository/quay/demo) 2020-07-23 07:15:02,677 [419] [DEBUG] [app] User loader loading deferred user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:15:02,677 [419] [DEBUG] [auth.cookie] Loading user from cookie: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:15:02,678 [438] [DEBUG] [app] User loader loading deferred user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:15:02,678 [438] [DEBUG] [auth.cookie] Loading user from cookie: 5b657e28-1928-415c-af1d-d7717a61299c gunicorn-web stdout | 2020-07-23 07:15:02,679 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', [u'5b657e28-1928-415c-af1d-d7717a61299c', False, 1, 0]) 2020-07-23 07:15:02,680 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', [u'5b657e28-1928-415c-af1d-d7717a61299c', False, 1, 0]) gunicorn-web stdout | 2020-07-23 07:15:02,688 [438] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [None, None, None, None, , None]) gunicorn-web stdout | 2020-07-23 07:15:02,688 [419] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [None, None, None, None, , None]) 2020-07-23 07:15:02,688 [438] [DEBUG] [auth.permissions] Identity loaded: 2020-07-23 07:15:02,688 [419] [DEBUG] [auth.permissions] Identity loaded: 2020-07-23 07:15:02,688 [438] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:15:02,688 [419] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c gunicorn-web stdout | 2020-07-23 07:15:02,690 [419] [DEBUG] [endpoints.api] Checking permission for repo: quay/demo gunicorn-web stdout | 2020-07-23 07:15:02,691 [419] [DEBUG] [auth.permissions] Loading user permissions after deferring for: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:15:02,691 [419] [DEBUG] [auth.permissions] User permission: userspecificneed(type='user', username=u'quay', role='admin') 2020-07-23 07:15:02,691 [419] [DEBUG] [auth.permissions] User namespace permission: namespacewide(type='organization', namespace=u'quay', role='admin') 2020-07-23 07:15:02,691 [419] [DEBUG] [auth.permissions] User namespace repo permission: namespacewide(type='organizationrepo', namespace=u'quay', role='admin') 2020-07-23 07:15:02,691 [419] [DEBUG] [auth.permissions] Adding superuser to user: quay gunicorn-web stdout | 2020-07-23 07:15:02,692 [438] [DEBUG] [endpoints.api] Checking permission for repo: quay/demo 2020-07-23 07:15:02,692 [438] [DEBUG] [auth.permissions] Loading user permissions after deferring for: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:15:02,692 [438] [DEBUG] [auth.permissions] User permission: userspecificneed(type='user', username=u'quay', role='admin') 2020-07-23 07:15:02,692 [438] [DEBUG] [auth.permissions] User namespace permission: namespacewide(type='organization', namespace=u'quay', role='admin') gunicorn-web stdout | 2020-07-23 07:15:02,692 [438] [DEBUG] [auth.permissions] User namespace repo permission: namespacewide(type='organizationrepo', namespace=u'quay', role='admin') 2020-07-23 07:15:02,692 [438] [DEBUG] [auth.permissions] Adding superuser to user: quay 2020-07-23 07:15:02,693 [438] [DEBUG] [endpoints.api.repository] Get repo: quay/demo gunicorn-web stdout | 2020-07-23 07:15:02,696 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', [u'quay', u'demo', 3, u'application', 1, 0]) gunicorn-web stdout | 2020-07-23 07:15:02,697 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', [u'quay', u'demo', 3, 1, 0]) gunicorn-web stdout | 2020-07-23 07:15:02,701 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."repository_id", "t1"."created" FROM "star" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."user_id" = %s)) LIMIT %s OFFSET %s', [1, 1, 1, 0]) gunicorn-web stdout | 2020-07-23 07:15:02,704 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', [u'public', 1, 0]) gunicorn-web stdout | 2020-07-23 07:15:02,705 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', [u'quay', u'demo', 3, 1, 0]) gunicorn-web stdout | 2020-07-23 07:15:02,706 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', []) gunicorn-web stdout | 2020-07-23 07:15:02,708 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', [u'public', 1, 0]) gunicorn-web stdout | 2020-07-23 07:15:02,709 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."count", "t1"."date" FROM "repositoryactioncount" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."date" >= %s))', [1, datetime.date(2020, 4, 22)]) gunicorn-web stdout | 2020-07-23 07:15:02,710 [438] [DEBUG] [auth.permissions] Loading user permissions after deferring for: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:15:02,711 [438] [DEBUG] [auth.permissions] Loading user permissions after deferring for: 5b657e28-1928-415c-af1d-d7717a61299c gunicorn-web stdout | 2020-07-23 07:15:02,713 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."repository_id", "t1"."manifest_id", "t1"."lifetime_start_ms", "t1"."lifetime_end_ms", "t1"."hidden", "t1"."reversion", "t1"."tag_kind_id", "t1"."linked_tag_id", "t2"."id", "t2"."digest", "t2"."media_type_id" FROM "tag" AS "t1" INNER JOIN "manifest" AS "t2" ON ("t1"."manifest_id" = "t2"."id") WHERE (((("t1"."repository_id" = %s) AND (("t1"."lifetime_end_ms" IS %s) OR ("t1"."lifetime_end_ms" > %s))) AND ("t1"."hidden" = %s)) AND ("t1"."hidden" = %s)) ORDER BY "t1"."lifetime_start_ms" DESC, "t1"."name" LIMIT %s OFFSET %s', [1, None, 1595488502710, False, False, 101, 0]) gunicorn-web stdout | 2020-07-23 07:15:02,717 [438] [DEBUG] [app] Ending request: urn:request:3479eb3c-4840-44a2-852a-d30b1a4ede77 (/api/v1/repository/quay/demo) gunicorn-web stdout | 2020-07-23 07:15:02,718 [419] [DEBUG] [app] Ending request: urn:request:c5a355ec-5560-47d3-a469-610396f77d45 (/api/v1/repository/quay/demo/tag/) gunicorn-web stdout | 2020-07-23 07:15:02,718 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:15:02,719 [438] [INFO] [gunicorn.access] 10.128.2.8 - - [23/Jul/2020:07:15:02 +0000] "GET /api/v1/repository/quay/demo?includeStats=true&includeTags=false HTTP/1.0" 200 3619 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/repository/quay/demo" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" gunicorn-web stdout | 2020-07-23 07:15:02,719 [419] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:15:02 +0000] "GET /api/v1/repository/quay/demo?includeStats=true&includeTags=false HTTP/2.0" 200 3619 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/repository/quay/demo" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.046 148 0.046) 10.128.2.8 () - - [23/Jul/2020:07:15:02 +0000] "GET /api/v1/repository/quay/demo/tag/?limit=100&page=1&onlyActiveTags=true HTTP/2.0" 200 49 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/repository/quay/demo" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.046 645 0.046) gunicorn-web stdout | 2020-07-23 07:15:02,720 [419] [INFO] [gunicorn.access] 10.128.2.8 - - [23/Jul/2020:07:15:02 +0000] "GET /api/v1/repository/quay/demo/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 49 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/repository/quay/demo" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" securityworker stdout | 2020-07-23 07:15:03,477 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run securityworker stdout | 2020-07-23 07:15:03,478 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:33.476607+00:00 (in 29.998909 seconds) 2020-07-23 07:15:03,478 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:15:33 UTC)" (scheduled at 2020-07-23 07:15:03.476607+00:00) 2020-07-23 07:15:03,478 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:15:33 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:15:03,487 [431] [DEBUG] [app] Starting request: urn:request:ef0d32a4-6218-4b9a-bef6-8be008eb9654 (/repository/quay/demo/status) gunicorn-web stdout | 2020-07-23 07:15:03,492 [431] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', [u'quay', u'demo', 3, 1, 0]) gunicorn-web stdout | 2020-07-23 07:15:03,501 [431] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0]) gunicorn-web stdout | 2020-07-23 07:15:03,504 [431] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t3"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', [u'quay', u'demo', u'public', 3, 1, 0]) gunicorn-web stdout | 2020-07-23 07:15:03,511 [431] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s OFFSET %s', [u'demo', u'quay', 1, 0]) builder stdout | 2020-07-23 07:15:03,517 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:15:03,521 [431] [DEBUG] [app] Ending request: urn:request:ef0d32a4-6218-4b9a-bef6-8be008eb9654 (/repository/quay/demo/status) gunicorn-web stdout | 2020-07-23 07:15:03,523 [431] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:15:03,524 [431] [INFO] [gunicorn.access] 10.128.2.8 - - [23/Jul/2020:07:15:03 +0000] "GET /repository/quay/demo/status?token=8e65ec30-9379-4f0c-94e5-71dc219efd24 HTTP/1.0" 200 740 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/repository/quay/demo" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:15:03 +0000] "GET /repository/quay/demo/status?token=8e65ec30-9379-4f0c-94e5-71dc219efd24 HTTP/2.0" 200 387 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/repository/quay/demo" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.040 113 0.040) gunicorn-web stdout | 2020-07-23 07:15:03,683 [419] [DEBUG] [app] Starting request: urn:request:65c13bdd-77ec-4280-8816-44e90a824bc2 (/api/v1/repository/quay/demo/build/) gunicorn-web stdout | 2020-07-23 07:15:03,684 [419] [DEBUG] [app] User loader loading deferred user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:15:03,684 [419] [DEBUG] [auth.cookie] Loading user from cookie: 5b657e28-1928-415c-af1d-d7717a61299c gunicorn-web stdout | 2020-07-23 07:15:03,686 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', [u'5b657e28-1928-415c-af1d-d7717a61299c', False, 1, 0]) gunicorn-web stdout | 2020-07-23 07:15:03,695 [419] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [None, None, None, None, , None]) gunicorn-web stdout | 2020-07-23 07:15:03,695 [419] [DEBUG] [auth.permissions] Identity loaded: 2020-07-23 07:15:03,695 [419] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:15:03,696 [419] [DEBUG] [endpoints.api] Checking permission for repo: quay/demo 2020-07-23 07:15:03,696 [419] [DEBUG] [auth.permissions] Loading user permissions after deferring for: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:15:03,696 [419] [DEBUG] [auth.permissions] User permission: userspecificneed(type='user', username=u'quay', role='admin') 2020-07-23 07:15:03,696 [419] [DEBUG] [auth.permissions] User namespace permission: namespacewide(type='organization', namespace=u'quay', role='admin') 2020-07-23 07:15:03,696 [419] [DEBUG] [auth.permissions] User namespace repo permission: namespacewide(type='organizationrepo', namespace=u'quay', role='admin') 2020-07-23 07:15:03,697 [419] [DEBUG] [auth.permissions] Adding superuser to user: quay gunicorn-web stdout | 2020-07-23 07:15:03,700 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', [u'quay', u'demo', 3, u'application', 1, 0]) gunicorn-web stdout | 2020-07-23 07:15:03,711 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', [u'demo', u'quay', 3]) gunicorn-web stdout | 2020-07-23 07:15:03,719 [419] [DEBUG] [app] Ending request: urn:request:65c13bdd-77ec-4280-8816-44e90a824bc2 (/api/v1/repository/quay/demo/build/) gunicorn-web stdout | 2020-07-23 07:15:03,721 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:15:03,722 [419] [INFO] [gunicorn.access] 10.128.2.8 - - [23/Jul/2020:07:15:03 +0000] "GET /api/v1/repository/quay/demo/build/?limit=3 HTTP/1.0" 200 15 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/repository/quay/demo" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:15:03 +0000] "GET /api/v1/repository/quay/demo/build/?limit=3 HTTP/2.0" 200 15 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/repository/quay/demo" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.042 83 0.042) exportactionlogsworker stdout | 2020-07-23 07:15:03,972 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:15:03,973 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:08.212267+00:00 (in 4.239592 seconds) 2020-07-23 07:15:03,973 [99] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:16:03 UTC)" (scheduled at 2020-07-23 07:15:03.971686+00:00) 2020-07-23 07:15:03,973 [99] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2020-07-23 07:15:03,976 [99] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 15, 3, 973819), True, datetime.datetime(2020, 7, 23, 7, 15, 3, 973819), 0, u'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2020-07-23 07:15:03,986 [99] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2020-07-23 07:15:03,986 [99] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:15:03,986 [99] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:16:03 UTC)" executed successfully builder stdout | 2020-07-23 07:15:04,517 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gcworker stdout | 2020-07-23 07:15:05,073 [110] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'gcworker.py', 'pid': '110'} gunicorn-web stdout | 2020-07-23 07:15:05,126 [423] [DEBUG] [app] Starting request: urn:request:1415a3d0-aaf7-480e-8007-5f1c117e7071 (/api/v1/repository/quay/demo/build/) 2020-07-23 07:15:05,126 [435] [DEBUG] [app] Starting request: urn:request:23f82f1b-e030-4307-9743-2e0637bb08a8 (/api/v1/repository/quay/demo/trigger/) 2020-07-23 07:15:05,127 [423] [DEBUG] [app] User loader loading deferred user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:15:05,127 [423] [DEBUG] [auth.cookie] Loading user from cookie: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:15:05,127 [435] [DEBUG] [app] User loader loading deferred user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:15:05,128 [435] [DEBUG] [auth.cookie] Loading user from cookie: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:15:05,129 [423] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', [u'5b657e28-1928-415c-af1d-d7717a61299c', False, 1, 0]) 2020-07-23 07:15:05,130 [435] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', [u'5b657e28-1928-415c-af1d-d7717a61299c', False, 1, 0]) gunicorn-web stdout | 2020-07-23 07:15:05,139 [423] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [None, None, None, None, , None]) gunicorn-web stdout | 2020-07-23 07:15:05,139 [435] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [None, None, None, None, , None]) 2020-07-23 07:15:05,140 [423] [DEBUG] [auth.permissions] Identity loaded: 2020-07-23 07:15:05,140 [423] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:15:05,140 [435] [DEBUG] [auth.permissions] Identity loaded: 2020-07-23 07:15:05,140 [435] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c gunicorn-web stdout | 2020-07-23 07:15:05,141 [423] [DEBUG] [endpoints.api] Checking permission for repo: quay/demo 2020-07-23 07:15:05,141 [423] [DEBUG] [auth.permissions] Loading user permissions after deferring for: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:15:05,141 [423] [DEBUG] [auth.permissions] User permission: userspecificneed(type='user', username=u'quay', role='admin') gunicorn-web stdout | 2020-07-23 07:15:05,141 [423] [DEBUG] [auth.permissions] User namespace permission: namespacewide(type='organization', namespace=u'quay', role='admin') 2020-07-23 07:15:05,141 [423] [DEBUG] [auth.permissions] User namespace repo permission: namespacewide(type='organizationrepo', namespace=u'quay', role='admin') 2020-07-23 07:15:05,142 [423] [DEBUG] [auth.permissions] Adding superuser to user: quay 2020-07-23 07:15:05,142 [435] [DEBUG] [endpoints.api] Checking permission for repo: quay/demo gunicorn-web stdout | 2020-07-23 07:15:05,142 [435] [DEBUG] [auth.permissions] Loading user permissions after deferring for: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:15:05,142 [435] [DEBUG] [auth.permissions] User permission: userspecificneed(type='user', username=u'quay', role='admin') 2020-07-23 07:15:05,142 [435] [DEBUG] [auth.permissions] User namespace permission: namespacewide(type='organization', namespace=u'quay', role='admin') 2020-07-23 07:15:05,143 [435] [DEBUG] [auth.permissions] User namespace repo permission: namespacewide(type='organizationrepo', namespace=u'quay', role='admin') gunicorn-web stdout | 2020-07-23 07:15:05,143 [435] [DEBUG] [auth.permissions] Adding superuser to user: quay gunicorn-web stdout | 2020-07-23 07:15:05,147 [423] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', [u'quay', u'demo', 3, u'application', 1, 0]) gunicorn-web stdout | 2020-07-23 07:15:05,153 [435] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', [u'quay', u'demo', 3, u'application', 1, 0]) gunicorn-web stdout | 2020-07-23 07:15:05,160 [423] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."access_token_id", "t1"."resource_key", "t1"."job_config", "t1"."phase", "t1"."started", "t1"."display_name", "t1"."trigger_id", "t1"."pull_robot_id", "t1"."logs_archived", "t1"."queue_id", "t2"."id", "t2"."uuid", "t2"."service_id", "t2"."repository_id", "t2"."connected_user_id", "t2"."secure_auth_token", "t2"."secure_private_key", "t2"."fully_migrated", "t2"."config", "t2"."write_token_id", "t2"."pull_robot_id", "t2"."enabled", "t2"."disabled_reason_id", "t2"."disabled_datetime", "t2"."successive_failure_count", "t2"."successive_internal_error_count", "t3"."id", "t3"."name", "t4"."id", "t4"."namespace_user_id", "t4"."name", "t4"."visibility_id", "t4"."description", "t4"."badge_token", "t4"."kind_id", "t4"."trust_enabled", "t4"."state", "t5"."id", "t5"."uuid", "t5"."username", "t5"."password_hash", "t5"."email", "t5"."verified", "t5"."stripe_id", "t5"."organization", "t5"."robot", "t5"."invoice_email", "t5"."invalid_login_attempts", "t5"."last_invalid_login", "t5"."removed_tag_expiration_s", "t5"."enabled", "t5"."invoice_email_address", "t5"."given_name", "t5"."family_name", "t5"."company", "t5"."location", "t5"."maximum_queued_builds_count", "t5"."creation_date", "t5"."last_accessed", "t6"."id", "t6"."uuid", "t6"."username", "t6"."password_hash", "t6"."email", "t6"."verified", "t6"."stripe_id", "t6"."organization", "t6"."robot", "t6"."invoice_email", "t6"."invalid_login_attempts", "t6"."last_invalid_login", "t6"."removed_tag_expiration_s", "t6"."enabled", "t6"."invoice_email_address", "t6"."given_name", "t6"."family_name", "t6"."company", "t6"."location", "t6"."maximum_queued_builds_count", "t6"."creation_date", "t6"."last_accessed" FROM "repositorybuild" AS "t1" INNER JOIN "repository" AS "t4" ON ("t1"."repository_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "user" AS "t6" ON ("t1"."pull_robot_id" = "t6"."id") LEFT OUTER JOIN "repositorybuildtrigger" AS "t2" ON ("t1"."trigger_id" = "t2"."id") LEFT OUTER JOIN "buildtriggerservice" AS "t3" ON ("t2"."service_id" = "t3"."id") WHERE (("t4"."name" = %s) AND ("t5"."username" = %s)) ORDER BY "t1"."started" DESC LIMIT %s', [u'demo', u'quay', 10]) gunicorn-web stdout | 2020-07-23 07:15:05,162 [435] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."service_id", "t1"."repository_id", "t1"."connected_user_id", "t1"."secure_auth_token", "t1"."secure_private_key", "t1"."fully_migrated", "t1"."config", "t1"."write_token_id", "t1"."pull_robot_id", "t1"."enabled", "t1"."disabled_reason_id", "t1"."disabled_datetime", "t1"."successive_failure_count", "t1"."successive_internal_error_count", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state" FROM "repositorybuildtrigger" AS "t1" INNER JOIN "buildtriggerservice" AS "t2" ON ("t1"."service_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") WHERE (("t4"."username" = %s) AND ("t3"."name" = %s))', [u'quay', u'demo']) gunicorn-web stdout | 2020-07-23 07:15:05,166 [435] [DEBUG] [app] Ending request: urn:request:23f82f1b-e030-4307-9743-2e0637bb08a8 (/api/v1/repository/quay/demo/trigger/) gunicorn-web stdout | 2020-07-23 07:15:05,168 [435] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:15:05,169 [423] [DEBUG] [app] Ending request: urn:request:1415a3d0-aaf7-480e-8007-5f1c117e7071 (/api/v1/repository/quay/demo/build/) 2020-07-23 07:15:05,169 [435] [INFO] [gunicorn.access] 10.128.2.8 - - [23/Jul/2020:07:15:05 +0000] "GET /api/v1/repository/quay/demo/trigger/ HTTP/1.0" 200 17 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/repository/quay/demo?tab=builds" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" gunicorn-web stdout | 2020-07-23 07:15:05,171 [423] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:15:05,172 [423] [INFO] [gunicorn.access] 10.128.2.8 - - [23/Jul/2020:07:15:05 +0000] "GET /api/v1/repository/quay/demo/build/?limit=10 HTTP/1.0" 200 15 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/repository/quay/demo?tab=builds" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:15:05 +0000] "GET /api/v1/repository/quay/demo/trigger/ HTTP/2.0" 200 17 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/repository/quay/demo?tab=builds" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.050 592 0.050) 10.128.2.8 () - - [23/Jul/2020:07:15:05 +0000] "GET /api/v1/repository/quay/demo/build/?limit=10 HTTP/2.0" 200 15 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/repository/quay/demo?tab=builds" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.050 146 0.050) expiredappspecifictokenworker stdout | 2020-07-23 07:15:05,457 [126] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '126'} builder stdout | 2020-07-23 07:15:05,517 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 securityworker stdout | 2020-07-23 07:15:06,116 [128] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'securityworker.py', 'pid': '128'} teamsyncworker stdout | 2020-07-23 07:15:06,430 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'teamsyncworker.py', 'pid': '115'} builder stdout | 2020-07-23 07:15:06,510 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 2020-07-23 07:15:06,510 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:15:05.517708 (running). builder stdout | 2020-07-23 07:15:06,517 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:15:06,545 [438] [DEBUG] [app] Starting request: urn:request:46631d3e-792a-4bc5-81d9-52f083c2577a (/api/v1/repository/quay/demo/trigger/) gunicorn-web stdout | 2020-07-23 07:15:06,545 [438] [DEBUG] [app] User loader loading deferred user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:15:06,546 [438] [DEBUG] [auth.cookie] Loading user from cookie: 5b657e28-1928-415c-af1d-d7717a61299c gunicorn-web stdout | 2020-07-23 07:15:06,547 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', [u'5b657e28-1928-415c-af1d-d7717a61299c', False, 1, 0]) gunicorn-web stdout | 2020-07-23 07:15:06,555 [438] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [None, None, None, None, , None]) gunicorn-web stdout | 2020-07-23 07:15:06,556 [438] [DEBUG] [auth.permissions] Identity loaded: 2020-07-23 07:15:06,556 [438] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:15:06,556 [438] [DEBUG] [endpoints.api] Checking permission for repo: quay/demo 2020-07-23 07:15:06,556 [438] [DEBUG] [auth.permissions] Loading user permissions after deferring for: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:15:06,557 [438] [DEBUG] [auth.permissions] User permission: userspecificneed(type='user', username=u'quay', role='admin') gunicorn-web stdout | 2020-07-23 07:15:06,557 [438] [DEBUG] [auth.permissions] User namespace permission: namespacewide(type='organization', namespace=u'quay', role='admin') 2020-07-23 07:15:06,557 [438] [DEBUG] [auth.permissions] User namespace repo permission: namespacewide(type='organizationrepo', namespace=u'quay', role='admin') 2020-07-23 07:15:06,557 [438] [DEBUG] [auth.permissions] Adding superuser to user: quay gunicorn-web stdout | 2020-07-23 07:15:06,559 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', [u'quay', u'demo', 3, u'application', 1, 0]) gunicorn-web stdout | 2020-07-23 07:15:06,566 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."service_id", "t1"."repository_id", "t1"."connected_user_id", "t1"."secure_auth_token", "t1"."secure_private_key", "t1"."fully_migrated", "t1"."config", "t1"."write_token_id", "t1"."pull_robot_id", "t1"."enabled", "t1"."disabled_reason_id", "t1"."disabled_datetime", "t1"."successive_failure_count", "t1"."successive_internal_error_count", "t2"."id", "t2"."name", "t3"."id", "t3"."namespace_user_id", "t3"."name", "t3"."visibility_id", "t3"."description", "t3"."badge_token", "t3"."kind_id", "t3"."trust_enabled", "t3"."state" FROM "repositorybuildtrigger" AS "t1" INNER JOIN "buildtriggerservice" AS "t2" ON ("t1"."service_id" = "t2"."id") INNER JOIN "repository" AS "t3" ON ("t1"."repository_id" = "t3"."id") INNER JOIN "user" AS "t4" ON ("t3"."namespace_user_id" = "t4"."id") WHERE (("t4"."username" = %s) AND ("t3"."name" = %s))', [u'quay', u'demo']) gunicorn-web stdout | 2020-07-23 07:15:06,570 [438] [DEBUG] [app] Ending request: urn:request:46631d3e-792a-4bc5-81d9-52f083c2577a (/api/v1/repository/quay/demo/trigger/) gunicorn-web stdout | 2020-07-23 07:15:06,571 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:15:06,572 [438] [INFO] [gunicorn.access] 10.128.2.8 - - [23/Jul/2020:07:15:06 +0000] "GET /api/v1/repository/quay/demo/trigger/ HTTP/1.0" 200 17 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/repository/quay/demo?tab=builds" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:15:06 +0000] "GET /api/v1/repository/quay/demo/trigger/ HTTP/2.0" 200 17 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/repository/quay/demo?tab=builds" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.031 499 0.031) namespacegcworker stdout | 2020-07-23 07:15:06,911 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:15:06,911 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:39.024941+00:00 (in 32.113649 seconds) 2020-07-23 07:15:06,911 [134] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:16:06 UTC)" (scheduled at 2020-07-23 07:15:06.910005+00:00) 2020-07-23 07:15:06,912 [134] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2020-07-23 07:15:06,914 [134] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 15, 6, 912276), True, datetime.datetime(2020, 7, 23, 7, 15, 6, 912276), 0, u'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2020-07-23 07:15:06,924 [134] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2020-07-23 07:15:06,925 [134] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:15:06,925 [134] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:16:06 UTC)" executed successfully notificationworker stdout | 2020-07-23 07:15:06,998 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:15:06,999 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:09.911177+00:00 (in 2.912158 seconds) 2020-07-23 07:15:06,999 [113] [INFO] [apscheduler.executors.default] Running job "update_queue_metrics (trigger: interval[0:05:00], next run at: 2020-07-23 07:20:06 UTC)" (scheduled at 2020-07-23 07:15:06.997992+00:00) notificationworker stdout | 2020-07-23 07:15:07,001 [113] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2020, 7, 23, 7, 15, 6, 999938), u'notification/%']) notificationworker stdout | 2020-07-23 07:15:07,010 [113] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2020, 7, 23, 7, 15, 6, 999938), True, datetime.datetime(2020, 7, 23, 7, 15, 6, 999938), 0, u'notification/%']) notificationworker stdout | 2020-07-23 07:15:07,013 [113] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2020, 7, 23, 7, 15, 6, 999938), True, datetime.datetime(2020, 7, 23, 7, 15, 6, 999938), 0, u'notification/%', False, datetime.datetime(2020, 7, 23, 7, 15, 6, 999938), u'notification/%']) notificationworker stdout | 2020-07-23 07:15:07,015 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:15:07,016 [113] [INFO] [apscheduler.executors.default] Job "update_queue_metrics (trigger: interval[0:05:00], next run at: 2020-07-23 07:20:06 UTC)" executed successfully builder stdout | 2020-07-23 07:15:07,517 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 exportactionlogsworker stdout | 2020-07-23 07:15:07,830 [99] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'exportactionlogsworker.py', 'pid': '99'} gunicorn-secscan stdout | 2020-07-23 07:15:07,988 [413] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '413'} gunicorn-secscan stdout | 2020-07-23 07:15:08,004 [412] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '412'} gunicorn-secscan stdout | 2020-07-23 07:15:08,027 [122] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '122'} gunicorn-secscan stdout | 2020-07-23 07:15:08,033 [411] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '411'} gunicorn-secscan stdout | 2020-07-23 07:15:08,037 [414] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '414'} exportactionlogsworker stdout | 2020-07-23 07:15:08,213 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:15:08,213 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:57.209762+00:00 (in 48.996286 seconds) exportactionlogsworker stdout | 2020-07-23 07:15:08,214 [99] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:16:08 UTC)" (scheduled at 2020-07-23 07:15:08.212267+00:00) 2020-07-23 07:15:08,214 [99] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:15:08,214 [99] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:16:08 UTC)" executed successfully queuecleanupworker stdout | 2020-07-23 07:15:08,261 [103] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'queuecleanupworker.py', 'pid': '103'} repositoryactioncounter stdout | 2020-07-23 07:15:08,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:15:08,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:18.291018+00:00 (in 9.998987 seconds) 2020-07-23 07:15:08,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:15:18 UTC)" (scheduled at 2020-07-23 07:15:08.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:15:08,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:15:08,304 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:15:08,304 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:15:08,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:15:18 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:15:08,383 [419] [DEBUG] [app] Starting request: urn:request:14540e07-6c99-4501-9331-f05fb157b654 (/health/instance) gunicorn-web stdout | 2020-07-23 07:15:08,386 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:15:08,393 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:15:08,395 [463] [DEBUG] [app] Starting request: urn:request:89eef958-fe13-420a-abef-2c2b5c15b233 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:15:08,396 [463] [DEBUG] [app] Ending request: urn:request:89eef958-fe13-420a-abef-2c2b5c15b233 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:15:08,397 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:08 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:08 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:15:08,398 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:15:08,399 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:15:08,406 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:15:08,415 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:15:08,423 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:15:08,425 [438] [DEBUG] [app] Starting request: urn:request:f3858269-12d4-458c-9961-17b5f52811fd (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:15:08,426 [438] [DEBUG] [app] Ending request: urn:request:f3858269-12d4-458c-9961-17b5f52811fd (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:15:08,427 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:08 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:08 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.005 159 0.005) gunicorn-web stdout | 2020-07-23 07:15:08,428 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:15:08,435 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:08 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:15:08,436 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:15:08,440 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:15:08,441 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:08 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:15:08,445 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:15:08,448 [466] [DEBUG] [app] Starting request: urn:request:77fdcd04-108f-4ac8-8ea3-396714ea38c1 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:15:08,449 [466] [DEBUG] [app] Ending request: urn:request:77fdcd04-108f-4ac8-8ea3-396714ea38c1 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:15:08,450 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:08 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.006 162 0.006) gunicorn-verbs stdout | 2020-07-23 07:15:08,451 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:08 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:15:08,453 [419] [DEBUG] [app] Ending request: urn:request:14540e07-6c99-4501-9331-f05fb157b654 (/health/instance) gunicorn-web stdout | 2020-07-23 07:15:08,454 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:15:08,454 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:15:08 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:15:08 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.074 49 0.074) builder stdout | 2020-07-23 07:15:08,518 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 globalpromstats stdout | 2020-07-23 07:15:09,112 [129] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'globalpromstats.py', 'pid': '129'} gunicorn-web stdout | 2020-07-23 07:15:09,385 [419] [DEBUG] [app] Starting request: urn:request:7135ab5c-5718-4553-b9a9-4bb9eddcee34 (/health/instance) gunicorn-web stdout | 2020-07-23 07:15:09,388 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:15:09,390 [463] [DEBUG] [app] Starting request: urn:request:ed04e6b6-0884-453d-8f3f-fbe639314f58 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:15:09,391 [463] [DEBUG] [app] Ending request: urn:request:ed04e6b6-0884-453d-8f3f-fbe639314f58 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:15:09,392 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:15:09,393 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:15:09,393 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:15:09,399 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:15:09,407 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:15:09,412 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:15:09,414 [419] [DEBUG] [app] Starting request: urn:request:c31b0da7-35f8-4898-ba40-4bb61b81aff2 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:15:09,416 [419] [DEBUG] [app] Ending request: urn:request:c31b0da7-35f8-4898-ba40-4bb61b81aff2 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:15:09,416 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:15:09,417 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:15:09,421 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:09 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:15:09,422 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:15:09,425 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:09 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:15:09,427 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:15:09,431 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:15:09,433 [460] [DEBUG] [app] Starting request: urn:request:6fd72563-0538-4006-aefb-58228dbea2ca (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:15:09,435 [460] [DEBUG] [app] Ending request: urn:request:6fd72563-0538-4006-aefb-58228dbea2ca (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:09 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:15:09,436 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:15:09,436 [460] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:09 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:15:09,438 [419] [DEBUG] [app] Ending request: urn:request:7135ab5c-5718-4553-b9a9-4bb9eddcee34 (/health/instance) gunicorn-web stdout | 2020-07-23 07:15:09,438 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:15:09,439 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:15:09 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:15:09 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.056 49 0.056) buildlogsarchiver stdout | 2020-07-23 07:15:09,472 [109] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'buildlogsarchiver.py', 'pid': '109'} builder stdout | 2020-07-23 07:15:09,518 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:15:09,704 [113] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'notificationworker.py', 'pid': '113'} notificationworker stdout | 2020-07-23 07:15:09,912 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:15:09,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:11.998621+00:00 (in 2.086298 seconds) 2020-07-23 07:15:09,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:15:19 UTC)" (scheduled at 2020-07-23 07:15:09.911177+00:00) 2020-07-23 07:15:09,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:15:09,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 15, 9, 913142), True, datetime.datetime(2020, 7, 23, 7, 15, 9, 913142), 0, u'notification/%', 50, 1, 0]) chunkcleanupworker stdout | 2020-07-23 07:15:09,924 [124] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'chunkcleanupworker.py', 'pid': '124'} notificationworker stdout | 2020-07-23 07:15:09,928 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:15:09,928 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:15:09,929 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:15:19 UTC)" executed successfully gcworker stdout | 2020-07-23 07:15:10,008 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2020-07-23 07:15:10,008 [110] [INFO] [apscheduler.executors.default] Running job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:15:10 UTC)" (scheduled at 2020-07-23 07:15:10.004697+00:00) gcworker stdout | 2020-07-23 07:15:10,010 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:40.004697+00:00 (in 29.996387 seconds) gcworker stdout | 2020-07-23 07:15:10,011 [110] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1594278910009, 1209600, 500, 1, 0]) gcworker stdout | 2020-07-23 07:15:10,021 [110] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2020-07-23 07:15:10,021 [110] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:15:10,021 [110] [INFO] [apscheduler.executors.default] Job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:15:40 UTC)" executed successfully builder stdout | 2020-07-23 07:15:10,518 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:15:11,211 [130] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'builder.py', 'pid': '130'} builder stdout | 2020-07-23 07:15:11,361 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:15:11,374 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:15:11,374 [130] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2020-07-23 07:15:11,437 [134] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'namespacegcworker.py', 'pid': '134'} repositorygcworker stdout | 2020-07-23 07:15:11,449 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositorygcworker.py', 'pid': '102'} builder stdout | 2020-07-23 07:15:11,518 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 blobuploadcleanupworker stdout | 2020-07-23 07:15:11,914 [119] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'blobuploadcleanupworker.py', 'pid': '119'} notificationworker stdout | 2020-07-23 07:15:11,999 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:15:12,000 [113] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:16:11 UTC)" (scheduled at 2020-07-23 07:15:11.998621+00:00) 2020-07-23 07:15:12,000 [113] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2020-07-23 07:15:12,000 [113] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:16:11 UTC)" executed successfully 2020-07-23 07:15:12,001 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:19.911177+00:00 (in 7.911513 seconds) builder stdout | 2020-07-23 07:15:12,519 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 security_notification_worker stdout | 2020-07-23 07:15:13,402 [101] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'security_notification_worker.py', 'pid': '101'} storagereplication stdout | 2020-07-23 07:15:13,436 [133] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'storagereplication.py', 'pid': '133'} logrotateworker stdout | 2020-07-23 07:15:13,459 [118] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'logrotateworker.py', 'pid': '118'} builder stdout | 2020-07-23 07:15:13,519 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:15:14,520 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:15:14,792 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositoryactioncounter.py', 'pid': '114'} gunicorn-web stdout | 2020-07-23 07:15:14,900 [419] [DEBUG] [app] Starting request: urn:request:98066c50-8f84-4a85-9640-a8bcedc46681 (/api/v1/filedrop/) gunicorn-web stdout | 2020-07-23 07:15:14,900 [419] [DEBUG] [app] User loader loading deferred user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:15:14,901 [419] [DEBUG] [auth.cookie] Loading user from cookie: 5b657e28-1928-415c-af1d-d7717a61299c gunicorn-web stdout | 2020-07-23 07:15:14,903 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', [u'5b657e28-1928-415c-af1d-d7717a61299c', False, 1, 0]) gunicorn-web stdout | 2020-07-23 07:15:14,912 [419] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [None, None, None, None, , None]) gunicorn-web stdout | 2020-07-23 07:15:14,912 [419] [DEBUG] [auth.permissions] Identity loaded: 2020-07-23 07:15:14,912 [419] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c gunicorn-web stdout | 2020-07-23 07:15:14,916 [419] [DEBUG] [data.userfiles] Requested upload url with content type: application/x-gzip gunicorn-web stdout | 2020-07-23 07:15:14,917 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:15:14,918 [419] [ERROR] [gunicorn.error] Error handling request /api/v1/filedrop/ Traceback (most recent call last): File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/gunicorn/workers/base_async.py", line 56, in handle self.handle_request(listener_name, req, client, addr) File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/gunicorn/workers/ggevent.py", line 160, in handle_request addr) File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/gunicorn/workers/base_async.py", line 107, in handle_request respiter = self.wsgi(environ, resp.start_response) File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/flask/app.py", line 2463, in __call__ return self.wsgi_app(environ, start_response) File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/werkzeug/middleware/proxy_fix.py", line 232, in __call__ return self.app(environ, start_response) File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/flask/app.py", line 2449, in wsgi_app response = self.handle_exception(e) File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router return original_handler(e) File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/flask/app.py", line 1866, in handle_exception reraise(exc_type, exc_value, tb) File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 266, in error_router return self.handle_error(e) File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/flask_restful/utils/cors.py", line 35, in wrapped_function resp = make_response(f(*args, **kwargs)) File "/quay-registry/endpoints/api/__init__.py", line 61, in handle_error return super(ApiExceptionHandlingApi, self).handle_error(error) File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/flask/app.py", line 2446, in wsgi_app response = self.full_dispatch_request() File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/flask/app.py", line 1951, in full_dispatch_request rv = self.handle_user_exception(e) File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 269, in error_router return original_handler(e) File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/flask/app.py", line 1820, in handle_user_exception reraise(exc_type, exc_value, tb) File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 266, in error_router return self.handle_error(e) File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/flask_restful/utils/cors.py", line 35, in wrapped_function resp = make_response(f(*args, **kwargs)) File "/quay-registry/endpoints/api/__init__.py", line 61, in handle_error return super(ApiExceptionHandlingApi, self).handle_error(error) File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/flask/app.py", line 1949, in full_dispatch_request rv = self.dispatch_request() File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/flask/app.py", line 1935, in dispatch_request return self.view_functions[rule.endpoint](**req.view_args) File "/quay-registry/endpoints/decorators.py", line 197, in wrapper return func(*args, **kwargs) File "/quay-registry/auth/decorators.py", line 65, in wrapper return func(*args, **kwargs) File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/flask_restful/utils/cors.py", line 35, in wrapped_function resp = make_response(f(*args, **kwargs)) File "/quay-registry/endpoints/csrf.py", line 73, in wrapper resp = func(*args, **kwargs) File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 458, in wrapper resp = resource(*args, **kwargs) File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/flask/views.py", line 89, in view return self.dispatch_request(*args, **kwargs) File "/opt/rh/python27/root/usr/lib/python2.7/site-packages/flask_restful/__init__.py", line 573, in dispatch_request resp = meth(*args, **kwargs) File "/quay-registry/endpoints/decorators.py", line 145, in wrapper return func(*args, **kwargs) File "/quay-registry/endpoints/decorators.py", line 120, in wrapper return func(*args, **kwargs) File "/quay-registry/endpoints/api/__init__.py", line 416, in wrapped return func(self, *args, **kwargs) File "/quay-registry/endpoints/api/build.py", line 544, in post (url, file_id) = user_files.prepare_for_drop(mime_type, requires_cors=True) File "/quay-registry/data/userfiles.py", line 94, in prepare_for_drop url = self._storage.get_direct_upload_url(self._locations, path, mime_type, requires_cors) File "/quay-registry/storage/distributedstorage.py", line 24, in wrapper storage = self._storages[random.sample(locations, 1)[0]] KeyError: 'default' gunicorn-web stdout | 2020-07-23 07:15:14,922 [419] [INFO] [gunicorn.access] - - [23/Jul/2020:07:15:14 +0000] "POST /api/v1/filedrop/ HTTP/1.0" 500 0 "-" "-" nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:15:14 +0000] "POST /api/v1/filedrop/ HTTP/2.0" 500 141 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/repository/quay/demo?tab=builds" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.025 547 0.025) gunicorn-web stdout | 2020-07-23 07:15:15,166 [419] [DEBUG] [app] Starting request: urn:request:05044a11-9a47-4472-9ded-f10b4881f4dc (/500) gunicorn-web stdout | 2020-07-23 07:15:15,188 [419] [DEBUG] [endpoints.api.discovery] Unable to find method for POST in class gunicorn-web stdout | 2020-07-23 07:15:15,203 [419] [DEBUG] [app] User loader loading deferred user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c gunicorn-web stdout | 2020-07-23 07:15:15,215 [419] [DEBUG] [app] Ending request: urn:request:05044a11-9a47-4472-9ded-f10b4881f4dc (/500) gunicorn-web stdout | 2020-07-23 07:15:15,217 [419] [INFO] [gunicorn.access] 10.128.2.8 - - [23/Jul/2020:07:15:15 +0000] "GET /500 HTTP/1.0" 200 2629 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/repository/quay/demo?tab=builds" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:15:15 +0000] "GET /500 HTTP/2.0" 200 980 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/repository/quay/demo?tab=builds" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.053 248 0.053) servicekey stdout | 2020-07-23 07:15:15,443 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'servicekeyworker.py', 'pid': '98'} builder stdout | 2020-07-23 07:15:15,519 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:15:15,691 [419] [DEBUG] [app] Starting request: urn:request:e7b7c85f-89c4-42b2-951e-70f939a45348 (/favicon.ico) 2020-07-23 07:15:15,694 [419] [DEBUG] [app] Ending request: urn:request:e7b7c85f-89c4-42b2-951e-70f939a45348 (/favicon.ico) nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:15:15 +0000] "GET /favicon.ico HTTP/2.0" 308 419 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.010 827 0.010) gunicorn-web stdout | 2020-07-23 07:15:15,698 [419] [INFO] [gunicorn.access] 10.128.2.8 - - [23/Jul/2020:07:15:15 +0000] "GET /favicon.ico HTTP/1.0" 308 419 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" gunicorn-web stdout | 2020-07-23 07:15:15,862 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '104'} gunicorn-web stdout | 2020-07-23 07:15:15,871 [435] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '435'} gunicorn-web stdout | 2020-07-23 07:15:15,897 [419] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '419'} gunicorn-web stdout | 2020-07-23 07:15:15,902 [438] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '438'} gunicorn-web stdout | 2020-07-23 07:15:15,906 [433] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '433'} gunicorn-web stdout | 2020-07-23 07:15:15,922 [431] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '431'} gunicorn-web stdout | 2020-07-23 07:15:15,931 [419] [DEBUG] [app] Starting request: urn:request:0eff6893-fa0f-4939-a836-dc63ecde8c5b (/favicon.ico/) gunicorn-web stdout | 2020-07-23 07:15:15,931 [419] [DEBUG] [app] User loader loading deferred user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c 2020-07-23 07:15:15,931 [419] [DEBUG] [auth.cookie] Loading user from cookie: 5b657e28-1928-415c-af1d-d7717a61299c gunicorn-web stdout | 2020-07-23 07:15:15,933 [436] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '436'} gunicorn-web stdout | 2020-07-23 07:15:15,933 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', [u'5b657e28-1928-415c-af1d-d7717a61299c', False, 1, 0]) gunicorn-web stdout | 2020-07-23 07:15:15,943 [419] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [None, None, None, None, , None]) gunicorn-web stdout | 2020-07-23 07:15:15,943 [419] [DEBUG] [auth.permissions] Identity loaded: 2020-07-23 07:15:15,944 [419] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: 5b657e28-1928-415c-af1d-d7717a61299c gunicorn-web stdout | 2020-07-23 07:15:15,946 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', [u'favicon.ico', False, 1, 0]) gunicorn-web stdout | 2020-07-23 07:15:15,949 [420] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '420'} gunicorn-web stdout | 2020-07-23 07:15:15,954 [423] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '423'} gunicorn-web stdout | 2020-07-23 07:15:15,991 [419] [DEBUG] [app] Ending request: urn:request:0eff6893-fa0f-4939-a836-dc63ecde8c5b (/favicon.ico/) gunicorn-web stdout | 2020-07-23 07:15:15,993 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:15:15,994 [419] [INFO] [gunicorn.access] 10.128.2.8 - - [23/Jul/2020:07:15:15 +0000] "GET /favicon.ico/ HTTP/1.0" 404 78980 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:15:15 +0000] "GET /favicon.ico/ HTTP/2.0" 404 12711 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.066 83 0.066) builder stdout | 2020-07-23 07:15:16,512 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:15:16,512 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:15:15.519829 (running). builder stdout | 2020-07-23 07:15:16,519 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:15:17,520 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:15:17 +0000] "GET /static/img/500/background.svg HTTP/2.0" 200 1126 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/500" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 153 -) nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:15:17 +0000] "GET /static/img/500/ship.svg HTTP/2.0" 200 1497 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/500" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 66 -) nginx stdout | 10.128.2.8 () - - [23/Jul/2020:07:15:17 +0000] "GET /static/img/500/water.svg HTTP/2.0" 200 1424 "https://demo-quayecosystem-quay-quay-enterprise.apps.quay-254.qe.gcp.devcluster.openshift.com/500" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Firefox/68.0" (0.000 67 -) repositoryactioncounter stdout | 2020-07-23 07:15:18,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:15:18,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:28.291018+00:00 (in 9.998951 seconds) 2020-07-23 07:15:18,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:15:28 UTC)" (scheduled at 2020-07-23 07:15:18.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:15:18,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:15:18,304 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:15:18,304 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:15:18,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:15:28 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:15:18,382 [419] [DEBUG] [app] Starting request: urn:request:2d3fd19d-f048-4cd6-96ac-aaeabc260cd9 (/health/instance) gunicorn-web stdout | 2020-07-23 07:15:18,385 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:15:18,391 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:15:18,393 [465] [DEBUG] [app] Starting request: urn:request:8da6efb6-e527-4d3b-b0b2-9ae2b53ea657 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:15:18,394 [465] [DEBUG] [app] Ending request: urn:request:8da6efb6-e527-4d3b-b0b2-9ae2b53ea657 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:15:18,394 [465] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:18 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:18 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:15:18,395 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:15:18,396 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:15:18,402 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:15:18,409 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:15:18,415 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:15:18,417 [419] [DEBUG] [app] Starting request: urn:request:58273f17-4cfb-4805-8c62-99f03ac2370c (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:15:18,418 [419] [DEBUG] [app] Ending request: urn:request:58273f17-4cfb-4805-8c62-99f03ac2370c (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:15:18,419 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:18 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:15:18,420 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:18 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:15:18,424 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:18 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:15:18,424 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:15:18,428 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:18 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:15:18,430 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:15:18,434 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:15:18,436 [468] [DEBUG] [app] Starting request: urn:request:876338d4-d8f6-4805-81f3-5f07b3e266dc (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:15:18,437 [468] [DEBUG] [app] Ending request: urn:request:876338d4-d8f6-4805-81f3-5f07b3e266dc (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:18 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:15:18,437 [468] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:18 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:15:18,437 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:15:18,439 [419] [DEBUG] [app] Ending request: urn:request:2d3fd19d-f048-4cd6-96ac-aaeabc260cd9 (/health/instance) 2020-07-23 07:15:18,440 [419] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:15:18 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.060 49 0.060) gunicorn-web stdout | 2020-07-23 07:15:18,441 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:15:18 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" builder stdout | 2020-07-23 07:15:18,520 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:15:19,385 [423] [DEBUG] [app] Starting request: urn:request:f0c9694e-1ffd-48d2-9abf-aea688310677 (/health/instance) gunicorn-web stdout | 2020-07-23 07:15:19,388 [423] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:15:19,393 [423] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:15:19,395 [481] [DEBUG] [app] Starting request: urn:request:205cb03b-a6f1-4ced-b6af-18102baa3328 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:15:19,396 [481] [DEBUG] [app] Ending request: urn:request:205cb03b-a6f1-4ced-b6af-18102baa3328 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:15:19,397 [481] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:19 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:15:19,397 [423] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:19 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:15:19,398 [423] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:15:19,404 [423] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:15:19,412 [423] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:15:19,417 [423] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:15:19,419 [423] [DEBUG] [app] Starting request: urn:request:a33fb4bb-c737-4d00-9e91-5d23ea430590 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:15:19,420 [423] [DEBUG] [app] Ending request: urn:request:a33fb4bb-c737-4d00-9e91-5d23ea430590 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:15:19,421 [423] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:19 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:19 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:15:19,422 [423] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:15:19,425 [423] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:15:19,426 [423] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:19 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:15:19,429 [423] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:15:19,431 [423] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:19 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:15:19,434 [423] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:15:19,436 [468] [DEBUG] [app] Starting request: urn:request:a522c2f4-f620-4b86-bf46-53823bdf1667 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:19 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:15:19,437 [468] [DEBUG] [app] Ending request: urn:request:a522c2f4-f620-4b86-bf46-53823bdf1667 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:15:19,438 [423] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:15:19,438 [468] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:19 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:15:19,441 [423] [DEBUG] [app] Ending request: urn:request:f0c9694e-1ffd-48d2-9abf-aea688310677 (/health/instance) gunicorn-web stdout | 2020-07-23 07:15:19,441 [423] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:15:19,442 [423] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:15:19 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:15:19 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.059 49 0.059) builder stdout | 2020-07-23 07:15:19,520 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:15:19,912 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:15:19,913 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:29.911177+00:00 (in 9.998148 seconds) 2020-07-23 07:15:19,913 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:15:29 UTC)" (scheduled at 2020-07-23 07:15:19.911177+00:00) 2020-07-23 07:15:19,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:15:19,916 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 15, 19, 913996), True, datetime.datetime(2020, 7, 23, 7, 15, 19, 913996), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:15:19,928 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:15:19,928 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:15:19,928 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:15:29 UTC)" executed successfully builder stdout | 2020-07-23 07:15:20,521 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:15:20,821 [130] [DEBUG] [buildman.server] Writing metrics builder stdout | 2020-07-23 07:15:20,834 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds builder stdout | 2020-07-23 07:15:21,376 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:15:21,381 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:15:21,382 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:15:21,521 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositorygcworker stdout | 2020-07-23 07:15:21,740 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:15:21,740 [102] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:16:21 UTC)" (scheduled at 2020-07-23 07:15:21.739118+00:00) 2020-07-23 07:15:21,741 [102] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2020-07-23 07:15:21,741 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:28.907644+00:00 (in 7.167269 seconds) repositorygcworker stdout | 2020-07-23 07:15:21,744 [102] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 15, 21, 741280), True, datetime.datetime(2020, 7, 23, 7, 15, 21, 741280), 0, u'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2020-07-23 07:15:21,753 [102] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:15:21,753 [102] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:15:21,753 [102] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:16:21 UTC)" executed successfully builder stdout | 2020-07-23 07:15:22,521 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-registry stdout | 2020-07-23 07:15:22,584 [469] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '469'} gunicorn-registry stdout | 2020-07-23 07:15:22,605 [100] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '100'} gunicorn-registry stdout | 2020-07-23 07:15:22,635 [463] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '463'} gunicorn-registry stdout | 2020-07-23 07:15:22,645 [477] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '477'} gunicorn-registry stdout | 2020-07-23 07:15:22,660 [478] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '478'} gunicorn-registry stdout | 2020-07-23 07:15:22,665 [470] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '470'} gunicorn-registry stdout | 2020-07-23 07:15:22,678 [476] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '476'} gunicorn-registry stdout | 2020-07-23 07:15:22,686 [480] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '480'} gunicorn-registry stdout | 2020-07-23 07:15:22,695 [467] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '467'} gunicorn-registry stdout | 2020-07-23 07:15:22,708 [475] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '475'} gunicorn-registry stdout | 2020-07-23 07:15:22,729 [479] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '479'} gunicorn-registry stdout | 2020-07-23 07:15:22,743 [474] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '474'} gunicorn-registry stdout | 2020-07-23 07:15:22,758 [472] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '472'} gunicorn-registry stdout | 2020-07-23 07:15:22,769 [465] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '465'} gunicorn-registry stdout | 2020-07-23 07:15:22,774 [473] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '473'} gunicorn-registry stdout | 2020-07-23 07:15:22,782 [471] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '471'} gunicorn-registry stdout | 2020-07-23 07:15:22,787 [481] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '481'} builder stdout | 2020-07-23 07:15:23,521 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-verbs stdout | 2020-07-23 07:15:24,361 [127] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'verbs:application', 'pid': '127'} builder stdout | 2020-07-23 07:15:24,521 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:15:25,522 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 buildlogsarchiver stdout | 2020-07-23 07:15:26,396 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:15:26,396 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:56.395393+00:00 (in 29.999001 seconds) 2020-07-23 07:15:26,396 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:15:56 UTC)" (scheduled at 2020-07-23 07:15:26.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:15:26,398 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 15, 26, 397219), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:15:26,406 [109] [DEBUG] [__main__] No more builds to archive 2020-07-23 07:15:26,407 [109] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2020-07-23 07:15:26,407 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:15:56 UTC)" executed successfully builder stdout | 2020-07-23 07:15:26,513 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:15:26,514 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:15:25.522487 (running). builder stdout | 2020-07-23 07:15:26,522 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:15:27,522 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:15:28,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:15:28,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:38.291018+00:00 (in 9.998966 seconds) repositoryactioncounter stdout | 2020-07-23 07:15:28,293 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:15:38 UTC)" (scheduled at 2020-07-23 07:15:28.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:15:28,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:15:28,304 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:15:28,304 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:15:28,305 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:15:38 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:15:28,382 [419] [DEBUG] [app] Starting request: urn:request:ab8aa85b-2b00-42b9-b341-4f26f8ecfaab (/health/instance) gunicorn-web stdout | 2020-07-23 07:15:28,385 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:15:28,391 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:15:28,392 [463] [DEBUG] [app] Starting request: urn:request:d4406a11-c731-455a-98b9-29c5c208aa23 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:15:28,394 [463] [DEBUG] [app] Ending request: urn:request:d4406a11-c731-455a-98b9-29c5c208aa23 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:28 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-registry stdout | 2020-07-23 07:15:28,394 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:28 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:15:28,395 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:15:28,396 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:15:28,402 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:15:28,409 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:15:28,414 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:15:28,416 [419] [DEBUG] [app] Starting request: urn:request:1f1bd357-f33d-4fe4-88cf-8f6f2705c9b4 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:15:28,417 [419] [DEBUG] [app] Ending request: urn:request:1f1bd357-f33d-4fe4-88cf-8f6f2705c9b4 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:15:28,417 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:28 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:28 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:15:28,418 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:15:28,422 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:28 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:15:28,423 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:15:28,426 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:15:28,427 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:28 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:15:28,431 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:15:28,433 [468] [DEBUG] [app] Starting request: urn:request:e9b3061b-a35c-4c20-a9b6-41b77f946627 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:15:28,434 [468] [DEBUG] [app] Ending request: urn:request:e9b3061b-a35c-4c20-a9b6-41b77f946627 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:28 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 162 0.002) gunicorn-verbs stdout | 2020-07-23 07:15:28,435 [468] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:28 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:15:28,435 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:15:28,437 [419] [DEBUG] [app] Ending request: urn:request:ab8aa85b-2b00-42b9-b341-4f26f8ecfaab (/health/instance) 2020-07-23 07:15:28,437 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:15:28,438 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:15:28 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:15:28 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.058 49 0.058) builder stdout | 2020-07-23 07:15:28,522 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositorygcworker stdout | 2020-07-23 07:15:28,911 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:15:28,912 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:16:21.739118+00:00 (in 52.827126 seconds) 2020-07-23 07:15:28,912 [102] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:16:28 UTC)" (scheduled at 2020-07-23 07:15:28.907644+00:00) 2020-07-23 07:15:28,913 [102] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2020-07-23 07:15:28,913 [102] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:16:28 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:15:29,384 [436] [DEBUG] [app] Starting request: urn:request:f33700ab-8c1c-46e4-bf1c-db8c684ddb3c (/health/instance) gunicorn-web stdout | 2020-07-23 07:15:29,387 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:15:29,392 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:15:29,394 [476] [DEBUG] [app] Starting request: urn:request:51bd69b5-5010-45e2-8693-62d0b3f44574 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:15:29,395 [476] [DEBUG] [app] Ending request: urn:request:51bd69b5-5010-45e2-8693-62d0b3f44574 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:15:29,395 [476] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:29 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:29 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:15:29,396 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:15:29,397 [436] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:15:29,404 [436] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:15:29,412 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:15:29,417 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:15:29,419 [438] [DEBUG] [app] Starting request: urn:request:1bb0aad9-b4b8-4d51-b415-74001e258053 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:15:29,420 [438] [DEBUG] [app] Ending request: urn:request:1bb0aad9-b4b8-4d51-b415-74001e258053 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:15:29,421 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:29 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:29 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:15:29,421 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:15:29,425 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:29 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:15:29,426 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:15:29,430 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:29 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:15:29,431 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:15:29,435 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:15:29,437 [460] [DEBUG] [app] Starting request: urn:request:34c6dd3f-0315-4fe3-90ec-632f6d7ecb7a (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:15:29,438 [460] [DEBUG] [app] Ending request: urn:request:34c6dd3f-0315-4fe3-90ec-632f6d7ecb7a (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:29 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:15:29,439 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:15:29,439 [460] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:29 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:15:29,441 [436] [DEBUG] [app] Ending request: urn:request:f33700ab-8c1c-46e4-bf1c-db8c684ddb3c (/health/instance) gunicorn-web stdout | 2020-07-23 07:15:29,442 [436] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:15:29,443 [436] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:15:29 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:15:29 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.059 49 0.059) builder stdout | 2020-07-23 07:15:29,523 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:15:29,914 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:15:29,915 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:39.911177+00:00 (in 9.996013 seconds) 2020-07-23 07:15:29,915 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:15:39 UTC)" (scheduled at 2020-07-23 07:15:29.911177+00:00) 2020-07-23 07:15:29,915 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:15:29,918 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 15, 29, 916107), True, datetime.datetime(2020, 7, 23, 7, 15, 29, 916107), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:15:29,927 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:15:29,927 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:15:29,927 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:15:39 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:15:30,353 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:15:30,353 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:16:00 UTC)" (scheduled at 2020-07-23 07:15:30.351857+00:00) 2020-07-23 07:15:30,353 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:52.446816+00:00 (in 22.093614 seconds) 2020-07-23 07:15:30,354 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:15:30,356 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 15, 30, 354442), True, datetime.datetime(2020, 7, 23, 7, 15, 30, 354442), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:15:30,364 [101] [DEBUG] [workers.queueworker] No more work. security_notification_worker stdout | 2020-07-23 07:15:30,364 [101] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:15:30,364 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:16:00 UTC)" executed successfully builder stdout | 2020-07-23 07:15:30,523 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:15:31,383 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:15:31,396 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:15:31,396 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:15:31,523 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:15:32,523 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 securityworker stdout | 2020-07-23 07:15:33,477 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run securityworker stdout | 2020-07-23 07:15:33,478 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:16:03.476607+00:00 (in 29.998759 seconds) 2020-07-23 07:15:33,478 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:16:03 UTC)" (scheduled at 2020-07-23 07:15:33.476607+00:00) securityworker stdout | 2020-07-23 07:15:33,479 [128] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "image" AS "t1" WHERE ("t1"."security_indexed_engine" < %s)', [3]) securityworker stdout | 2020-07-23 07:15:33,486 [128] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "image" AS "t1"', []) securityworker stdout | 2020-07-23 07:15:33,488 [128] [DEBUG] [data.secscan_model.secscan_v2_model] Found no additional images to scan 2020-07-23 07:15:33,488 [128] [DEBUG] [data.database] Disconnecting from database. securityworker stdout | 2020-07-23 07:15:33,489 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:16:03 UTC)" executed successfully builder stdout | 2020-07-23 07:15:33,524 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:15:34,524 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gcworker stdout | 2020-07-23 07:15:35,112 [110] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'gcworker.py', 'pid': '110'} expiredappspecifictokenworker stdout | 2020-07-23 07:15:35,478 [126] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '126'} builder stdout | 2020-07-23 07:15:35,525 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 securityworker stdout | 2020-07-23 07:15:36,151 [128] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'securityworker.py', 'pid': '128'} teamsyncworker stdout | 2020-07-23 07:15:36,468 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'teamsyncworker.py', 'pid': '115'} builder stdout | 2020-07-23 07:15:36,514 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 2020-07-23 07:15:36,515 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:15:35.525404 (running). builder stdout | 2020-07-23 07:15:36,524 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:15:37,525 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 exportactionlogsworker stdout | 2020-07-23 07:15:37,871 [99] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'exportactionlogsworker.py', 'pid': '99'} gunicorn-secscan stdout | 2020-07-23 07:15:37,999 [413] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '413'} gunicorn-secscan stdout | 2020-07-23 07:15:38,015 [412] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '412'} gunicorn-secscan stdout | 2020-07-23 07:15:38,038 [122] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '122'} gunicorn-secscan stdout | 2020-07-23 07:15:38,044 [411] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '411'} gunicorn-secscan stdout | 2020-07-23 07:15:38,048 [414] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '414'} repositoryactioncounter stdout | 2020-07-23 07:15:38,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:15:38,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:48.291018+00:00 (in 9.999131 seconds) 2020-07-23 07:15:38,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:15:48 UTC)" (scheduled at 2020-07-23 07:15:38.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:15:38,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) queuecleanupworker stdout | 2020-07-23 07:15:38,301 [103] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'queuecleanupworker.py', 'pid': '103'} repositoryactioncounter stdout | 2020-07-23 07:15:38,304 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:15:38,304 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:15:38,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:15:48 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:15:38,383 [419] [DEBUG] [app] Starting request: urn:request:55564a87-c94d-4ca9-9afd-57223c928626 (/health/instance) gunicorn-web stdout | 2020-07-23 07:15:38,387 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:15:38,393 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:15:38,395 [480] [DEBUG] [app] Starting request: urn:request:cdac0805-e353-44dc-9f92-e3c103607717 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:15:38,396 [480] [DEBUG] [app] Ending request: urn:request:cdac0805-e353-44dc-9f92-e3c103607717 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:15:38,397 [480] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:38 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:38 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.005 162 0.005) gunicorn-web stdout | 2020-07-23 07:15:38,398 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:15:38,399 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:15:38,405 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:15:38,413 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:15:38,419 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:15:38,421 [419] [DEBUG] [app] Starting request: urn:request:5193ff4f-a6f9-4191-b47c-6e0368068da1 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:15:38,422 [419] [DEBUG] [app] Ending request: urn:request:5193ff4f-a6f9-4191-b47c-6e0368068da1 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:15:38,423 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:38 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:38 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:15:38,424 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:15:38,429 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:38 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:15:38,430 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:15:38,433 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:38 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:15:38,435 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:15:38,439 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:15:38,441 [459] [DEBUG] [app] Starting request: urn:request:5e091821-5da2-4acc-a082-1a2dd1744cc4 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:38 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 162 0.002) gunicorn-verbs stdout | 2020-07-23 07:15:38,442 [459] [DEBUG] [app] Ending request: urn:request:5e091821-5da2-4acc-a082-1a2dd1744cc4 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:15:38,443 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:15:38,442 [459] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:38 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:15:38,445 [419] [DEBUG] [app] Ending request: urn:request:55564a87-c94d-4ca9-9afd-57223c928626 (/health/instance) gunicorn-web stdout | 2020-07-23 07:15:38,446 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:15:38,447 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:15:38 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:15:38 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.066 49 0.066) builder stdout | 2020-07-23 07:15:38,525 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 namespacegcworker stdout | 2020-07-23 07:15:39,028 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:15:39,029 [134] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:16:39 UTC)" (scheduled at 2020-07-23 07:15:39.024941+00:00) 2020-07-23 07:15:39,029 [134] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:15:39,029 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:16:06.910005+00:00 (in 27.881006 seconds) namespacegcworker stdout | 2020-07-23 07:15:39,029 [134] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:16:39 UTC)" executed successfully globalpromstats stdout | 2020-07-23 07:15:39,151 [129] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'globalpromstats.py', 'pid': '129'} gunicorn-web stdout | 2020-07-23 07:15:39,395 [438] [DEBUG] [app] Starting request: urn:request:ac07c44c-c317-41bf-997f-2ad2aaff21da (/health/instance) gunicorn-web stdout | 2020-07-23 07:15:39,397 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:15:39,403 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:15:39,405 [479] [DEBUG] [app] Starting request: urn:request:1f026766-832d-4c0a-b1a7-d91ef88b5a8b (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:15:39,406 [479] [DEBUG] [app] Ending request: urn:request:1f026766-832d-4c0a-b1a7-d91ef88b5a8b (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-registry stdout | 2020-07-23 07:15:39,407 [479] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:15:39,407 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:15:39,408 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:15:39,415 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:15:39,423 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:15:39,429 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:15:39,430 [438] [DEBUG] [app] Starting request: urn:request:754cb16f-22a6-43cd-80b7-9b4c29a7eae8 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:15:39,431 [438] [DEBUG] [app] Ending request: urn:request:754cb16f-22a6-43cd-80b7-9b4c29a7eae8 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:15:39,432 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:15:39,432 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:15:39,436 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:15:39,437 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:39 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:15:39,440 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:39 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.002 153 0.002) gunicorn-web stdout | 2020-07-23 07:15:39,442 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:15:39,446 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:15:39,448 [466] [DEBUG] [app] Starting request: urn:request:033904f9-2464-49ef-bcaf-d57cd63d34ff (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:39 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:15:39,449 [466] [DEBUG] [app] Ending request: urn:request:033904f9-2464-49ef-bcaf-d57cd63d34ff (/c1/_internal_ping) 2020-07-23 07:15:39,449 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:39 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:15:39,449 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:15:39,451 [438] [DEBUG] [app] Ending request: urn:request:ac07c44c-c317-41bf-997f-2ad2aaff21da (/health/instance) 2020-07-23 07:15:39,451 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:15:39,452 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:15:39 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:15:39 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.059 49 0.059) buildlogsarchiver stdout | 2020-07-23 07:15:39,512 [109] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'buildlogsarchiver.py', 'pid': '109'} builder stdout | 2020-07-23 07:15:39,525 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:15:39,742 [113] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'notificationworker.py', 'pid': '113'} notificationworker stdout | 2020-07-23 07:15:39,912 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:15:39,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:15:49 UTC)" (scheduled at 2020-07-23 07:15:39.911177+00:00) 2020-07-23 07:15:39,913 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:49.911177+00:00 (in 9.998649 seconds) 2020-07-23 07:15:39,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:15:39,916 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 15, 39, 913715), True, datetime.datetime(2020, 7, 23, 7, 15, 39, 913715), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:15:39,926 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:15:39,926 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:15:39,926 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:15:49 UTC)" executed successfully chunkcleanupworker stdout | 2020-07-23 07:15:39,954 [124] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'chunkcleanupworker.py', 'pid': '124'} gcworker stdout | 2020-07-23 07:15:40,009 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2020-07-23 07:15:40,009 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:16:10.004697+00:00 (in 29.995442 seconds) 2020-07-23 07:15:40,010 [110] [INFO] [apscheduler.executors.default] Running job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:16:10 UTC)" (scheduled at 2020-07-23 07:15:40.004697+00:00) gcworker stdout | 2020-07-23 07:15:40,011 [110] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1594278940010, 1209600, 500, 1, 0]) gcworker stdout | 2020-07-23 07:15:40,021 [110] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2020-07-23 07:15:40,021 [110] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:15:40,021 [110] [INFO] [apscheduler.executors.default] Job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:16:10 UTC)" executed successfully builder stdout | 2020-07-23 07:15:40,525 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:15:41,241 [130] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'builder.py', 'pid': '130'} builder stdout | 2020-07-23 07:15:41,397 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:15:41,410 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:15:41,410 [130] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2020-07-23 07:15:41,476 [134] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'namespacegcworker.py', 'pid': '134'} repositorygcworker stdout | 2020-07-23 07:15:41,488 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositorygcworker.py', 'pid': '102'} builder stdout | 2020-07-23 07:15:41,526 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 blobuploadcleanupworker stdout | 2020-07-23 07:15:41,954 [119] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'blobuploadcleanupworker.py', 'pid': '119'} builder stdout | 2020-07-23 07:15:42,526 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 security_notification_worker stdout | 2020-07-23 07:15:43,444 [101] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'security_notification_worker.py', 'pid': '101'} storagereplication stdout | 2020-07-23 07:15:43,479 [133] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'storagereplication.py', 'pid': '133'} logrotateworker stdout | 2020-07-23 07:15:43,499 [118] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'logrotateworker.py', 'pid': '118'} builder stdout | 2020-07-23 07:15:43,526 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:15:44,527 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:15:44,832 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositoryactioncounter.py', 'pid': '114'} servicekey stdout | 2020-07-23 07:15:45,480 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'servicekeyworker.py', 'pid': '98'} builder stdout | 2020-07-23 07:15:45,527 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:15:45,873 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '104'} gunicorn-web stdout | 2020-07-23 07:15:45,884 [435] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '435'} gunicorn-web stdout | 2020-07-23 07:15:45,912 [419] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '419'} gunicorn-web stdout | 2020-07-23 07:15:45,921 [438] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '438'} gunicorn-web stdout | 2020-07-23 07:15:45,927 [433] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '433'} gunicorn-web stdout | 2020-07-23 07:15:45,932 [431] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '431'} gunicorn-web stdout | 2020-07-23 07:15:45,946 [436] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '436'} gunicorn-web stdout | 2020-07-23 07:15:45,962 [420] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '420'} gunicorn-web stdout | 2020-07-23 07:15:45,968 [423] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '423'} builder stdout | 2020-07-23 07:15:46,516 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:15:46,517 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:15:45.527449 (running). builder stdout | 2020-07-23 07:15:46,527 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:15:47,527 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:15:48,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:15:48,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:58.291018+00:00 (in 9.998954 seconds) 2020-07-23 07:15:48,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:15:58 UTC)" (scheduled at 2020-07-23 07:15:48.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:15:48,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:15:48,304 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:15:48,304 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:15:48,305 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:15:58 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:15:48,382 [419] [DEBUG] [app] Starting request: urn:request:a4945ebc-9c58-4d10-85a9-a1408208ab32 (/health/instance) gunicorn-web stdout | 2020-07-23 07:15:48,385 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:15:48,391 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:15:48,393 [463] [DEBUG] [app] Starting request: urn:request:8ee70ec1-b5a0-441d-99f6-7d8525a256a3 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:15:48,394 [463] [DEBUG] [app] Ending request: urn:request:8ee70ec1-b5a0-441d-99f6-7d8525a256a3 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:15:48,395 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:15:48,395 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:15:48,397 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:15:48,403 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:15:48,412 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:15:48,417 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:15:48,418 [419] [DEBUG] [app] Starting request: urn:request:fcd3a351-31b0-4753-befb-36de1cde9f57 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:15:48,419 [419] [DEBUG] [app] Ending request: urn:request:fcd3a351-31b0-4753-befb-36de1cde9f57 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:48 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:15:48,420 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:48 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:15:48,420 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:15:48,425 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:48 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:15:48,425 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:15:48,429 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:48 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:15:48,430 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:15:48,434 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:15:48,436 [466] [DEBUG] [app] Starting request: urn:request:a8711e7d-0235-4342-9147-d8d43be16369 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:15:48,437 [466] [DEBUG] [app] Ending request: urn:request:a8711e7d-0235-4342-9147-d8d43be16369 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:48 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:15:48,438 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:15:48,438 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:48 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:15:48,440 [419] [DEBUG] [app] Ending request: urn:request:a4945ebc-9c58-4d10-85a9-a1408208ab32 (/health/instance) 2020-07-23 07:15:48,440 [419] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:15:48 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.061 49 0.061) gunicorn-web stdout | 2020-07-23 07:15:48,441 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:15:48 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" builder stdout | 2020-07-23 07:15:48,527 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:15:49,384 [431] [DEBUG] [app] Starting request: urn:request:3eba9076-2fc4-4fdd-a29b-c5c35183411a (/health/instance) gunicorn-web stdout | 2020-07-23 07:15:49,387 [431] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:15:49,392 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:15:49,395 [463] [DEBUG] [app] Starting request: urn:request:b2525729-1bc5-4e17-a449-5ee7eab085ab (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:15:49,396 [463] [DEBUG] [app] Ending request: urn:request:b2525729-1bc5-4e17-a449-5ee7eab085ab (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:49 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-registry stdout | 2020-07-23 07:15:49,396 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:49 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:15:49,397 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:15:49,398 [431] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:15:49,404 [431] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:15:49,411 [431] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:15:49,416 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:15:49,418 [436] [DEBUG] [app] Starting request: urn:request:1baf5dd6-fa80-4418-b550-ef7c6ced94d2 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:15:49,419 [436] [DEBUG] [app] Ending request: urn:request:1baf5dd6-fa80-4418-b550-ef7c6ced94d2 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:49 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:15:49,420 [436] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:49 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:15:49,420 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:15:49,424 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:49 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:15:49,425 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:15:49,429 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:49 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:15:49,430 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:15:49,434 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:15:49,437 [459] [DEBUG] [app] Starting request: urn:request:29ae0b26-1df7-4246-bcc8-c133895c6656 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:15:49,438 [459] [DEBUG] [app] Ending request: urn:request:29ae0b26-1df7-4246-bcc8-c133895c6656 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:49 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:15:49,438 [459] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:49 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:15:49,439 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:15:49,441 [431] [DEBUG] [app] Ending request: urn:request:3eba9076-2fc4-4fdd-a29b-c5c35183411a (/health/instance) gunicorn-web stdout | 2020-07-23 07:15:49,441 [431] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:15:49,442 [431] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:15:49 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:15:49 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.059 49 0.059) builder stdout | 2020-07-23 07:15:49,527 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:15:49,915 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:15:49,916 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:15:59.911177+00:00 (in 9.995337 seconds) notificationworker stdout | 2020-07-23 07:15:49,916 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:15:59 UTC)" (scheduled at 2020-07-23 07:15:49.911177+00:00) 2020-07-23 07:15:49,920 [113] [DEBUG] [workers.queueworker] Getting work item from queue. 2020-07-23 07:15:49,922 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 15, 49, 920535), True, datetime.datetime(2020, 7, 23, 7, 15, 49, 920535), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:15:49,934 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:15:49,935 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:15:49,935 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:15:59 UTC)" executed successfully builder stdout | 2020-07-23 07:15:50,528 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:15:50,836 [130] [DEBUG] [buildman.server] Writing metrics builder stdout | 2020-07-23 07:15:50,849 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds builder stdout | 2020-07-23 07:15:51,411 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:15:51,417 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:15:51,418 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:15:51,528 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 security_notification_worker stdout | 2020-07-23 07:15:52,448 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:15:52,449 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:16:00.351857+00:00 (in 7.903378 seconds) 2020-07-23 07:15:52,449 [101] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:16:52 UTC)" (scheduled at 2020-07-23 07:15:52.446816+00:00) 2020-07-23 07:15:52,449 [101] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:15:52,449 [101] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:16:52 UTC)" executed successfully builder stdout | 2020-07-23 07:15:52,528 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-registry stdout | 2020-07-23 07:15:52,597 [469] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '469'} gunicorn-registry stdout | 2020-07-23 07:15:52,617 [100] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '100'} gunicorn-registry stdout | 2020-07-23 07:15:52,646 [463] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '463'} gunicorn-registry stdout | 2020-07-23 07:15:52,660 [477] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '477'} gunicorn-registry stdout | 2020-07-23 07:15:52,675 [478] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '478'} gunicorn-registry stdout | 2020-07-23 07:15:52,680 [470] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '470'} gunicorn-registry stdout | 2020-07-23 07:15:52,691 [476] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '476'} gunicorn-registry stdout | 2020-07-23 07:15:52,700 [480] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '480'} gunicorn-registry stdout | 2020-07-23 07:15:52,707 [467] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '467'} gunicorn-registry stdout | 2020-07-23 07:15:52,722 [475] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '475'} gunicorn-registry stdout | 2020-07-23 07:15:52,744 [479] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '479'} gunicorn-registry stdout | 2020-07-23 07:15:52,761 [474] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '474'} gunicorn-registry stdout | 2020-07-23 07:15:52,773 [472] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '472'} gunicorn-registry stdout | 2020-07-23 07:15:52,782 [465] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '465'} gunicorn-registry stdout | 2020-07-23 07:15:52,793 [473] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '473'} gunicorn-registry stdout | 2020-07-23 07:15:52,803 [471] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '471'} gunicorn-registry stdout | 2020-07-23 07:15:52,809 [481] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '481'} builder stdout | 2020-07-23 07:15:53,528 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-verbs stdout | 2020-07-23 07:15:54,470 [127] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'verbs:application', 'pid': '127'} builder stdout | 2020-07-23 07:15:54,529 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:15:55,529 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 buildlogsarchiver stdout | 2020-07-23 07:15:56,396 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:15:56,397 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:16:26.395393+00:00 (in 29.998769 seconds) 2020-07-23 07:15:56,397 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:16:26 UTC)" (scheduled at 2020-07-23 07:15:56.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:15:56,399 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 15, 56, 397637), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:15:56,408 [109] [DEBUG] [__main__] No more builds to archive 2020-07-23 07:15:56,408 [109] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2020-07-23 07:15:56,408 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:16:26 UTC)" executed successfully builder stdout | 2020-07-23 07:15:56,518 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:15:56,518 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:15:55.529450 (running). builder stdout | 2020-07-23 07:15:56,532 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 exportactionlogsworker stdout | 2020-07-23 07:15:57,210 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:15:57,211 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:16:03.971686+00:00 (in 6.760905 seconds) 2020-07-23 07:15:57,211 [99] [INFO] [apscheduler.executors.default] Running job "update_queue_metrics (trigger: interval[0:05:00], next run at: 2020-07-23 07:20:57 UTC)" (scheduled at 2020-07-23 07:15:57.209762+00:00) exportactionlogsworker stdout | 2020-07-23 07:15:57,213 [99] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2020, 7, 23, 7, 15, 57, 211806), u'exportactionlogs/%']) exportactionlogsworker stdout | 2020-07-23 07:15:57,221 [99] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2020, 7, 23, 7, 15, 57, 211806), True, datetime.datetime(2020, 7, 23, 7, 15, 57, 211806), 0, u'exportactionlogs/%']) exportactionlogsworker stdout | 2020-07-23 07:15:57,225 [99] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2020, 7, 23, 7, 15, 57, 211806), True, datetime.datetime(2020, 7, 23, 7, 15, 57, 211806), 0, u'exportactionlogs/%', False, datetime.datetime(2020, 7, 23, 7, 15, 57, 211806), u'exportactionlogs/%']) exportactionlogsworker stdout | 2020-07-23 07:15:57,227 [99] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2020-07-23 07:15:57,227 [99] [INFO] [apscheduler.executors.default] Job "update_queue_metrics (trigger: interval[0:05:00], next run at: 2020-07-23 07:20:57 UTC)" executed successfully builder stdout | 2020-07-23 07:15:57,529 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:15:58,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:15:58,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:16:08.291018+00:00 (in 9.999120 seconds) 2020-07-23 07:15:58,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:16:08 UTC)" (scheduled at 2020-07-23 07:15:58.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:15:58,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:15:58,304 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:15:58,304 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:15:58,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:16:08 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:15:58,382 [419] [DEBUG] [app] Starting request: urn:request:9a775af3-ba42-4bfc-babd-826bee3134fc (/health/instance) gunicorn-web stdout | 2020-07-23 07:15:58,385 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:15:58,391 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:15:58,393 [475] [DEBUG] [app] Starting request: urn:request:243cab53-3c9c-435a-b461-a4b18ef4793f (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:15:58,394 [475] [DEBUG] [app] Ending request: urn:request:243cab53-3c9c-435a-b461-a4b18ef4793f (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:15:58,395 [475] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.005 162 0.005) gunicorn-web stdout | 2020-07-23 07:15:58,397 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:15:58,398 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:15:58,403 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:15:58,410 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:15:58,415 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:15:58,417 [438] [DEBUG] [app] Starting request: urn:request:ef2218c9-f13a-4863-8045-019bdc1821cc (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:15:58,418 [438] [DEBUG] [app] Ending request: urn:request:ef2218c9-f13a-4863-8045-019bdc1821cc (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:58 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:15:58,418 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:58 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:15:58,419 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:15:58,422 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:58 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:15:58,423 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:15:58,428 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:58 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:15:58,429 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:15:58,434 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:15:58,436 [458] [DEBUG] [app] Starting request: urn:request:ac6e71ba-6b5c-43ef-842f-57dedc44b35d (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:15:58,437 [458] [DEBUG] [app] Ending request: urn:request:ac6e71ba-6b5c-43ef-842f-57dedc44b35d (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:58 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 162 0.002) gunicorn-verbs stdout | 2020-07-23 07:15:58,438 [458] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:58 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:15:58,438 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:15:58,440 [419] [DEBUG] [app] Ending request: urn:request:9a775af3-ba42-4bfc-babd-826bee3134fc (/health/instance) 2020-07-23 07:15:58,440 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:15:58,441 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:15:58 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:15:58 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.060 49 0.060) builder stdout | 2020-07-23 07:15:58,529 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:15:59,384 [431] [DEBUG] [app] Starting request: urn:request:fcdd6549-5c0f-4421-af8d-4c2af50c74bb (/health/instance) gunicorn-web stdout | 2020-07-23 07:15:59,387 [431] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:15:59,392 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:15:59,394 [481] [DEBUG] [app] Starting request: urn:request:72bb4d91-5309-49ea-a4df-a63923968e94 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:15:59,395 [481] [DEBUG] [app] Ending request: urn:request:72bb4d91-5309-49ea-a4df-a63923968e94 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:59 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-registry stdout | 2020-07-23 07:15:59,396 [481] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:59 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:15:59,396 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:15:59,397 [431] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:15:59,402 [431] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:15:59,410 [431] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:15:59,415 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:15:59,417 [438] [DEBUG] [app] Starting request: urn:request:3d693d52-3b63-48eb-b50b-445e0059c190 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:15:59,418 [438] [DEBUG] [app] Ending request: urn:request:3d693d52-3b63-48eb-b50b-445e0059c190 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:59 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:15:59,419 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:59 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:15:59,419 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:15:59,423 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:59 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:15:59,424 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:15:59,428 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:15:59,429 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:59 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:15:59,433 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:15:59,435 [459] [DEBUG] [app] Starting request: urn:request:3242945c-ac99-4a9a-b30a-06927a483d79 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:15:59,436 [459] [DEBUG] [app] Ending request: urn:request:3242945c-ac99-4a9a-b30a-06927a483d79 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:15:59 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:15:59,437 [459] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:15:59 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:15:59,437 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:15:59,440 [431] [DEBUG] [app] Ending request: urn:request:fcdd6549-5c0f-4421-af8d-4c2af50c74bb (/health/instance) 2020-07-23 07:15:59,440 [431] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:15:59,441 [431] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:15:59 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:15:59 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.058 49 0.058) builder stdout | 2020-07-23 07:15:59,530 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:15:59,912 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:15:59,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:15:59 UTC)" (scheduled at 2020-07-23 07:15:59.911177+00:00) 2020-07-23 07:15:59,912 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:15:59,914 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 15, 59, 912939), True, datetime.datetime(2020, 7, 23, 7, 15, 59, 912939), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:15:59,915 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:16:09.911177+00:00 (in 9.998915 seconds) notificationworker stdout | 2020-07-23 07:15:59,924 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:15:59,924 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:15:59,925 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:16:09 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:16:00,352 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:16:00,353 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:16:30 UTC)" (scheduled at 2020-07-23 07:16:00.351857+00:00) 2020-07-23 07:16:00,353 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:16:00,356 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 16, 0, 354032), True, datetime.datetime(2020, 7, 23, 7, 16, 0, 354032), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:16:00,356 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:16:30.351857+00:00 (in 29.998820 seconds) security_notification_worker stdout | 2020-07-23 07:16:00,365 [101] [DEBUG] [workers.queueworker] No more work. security_notification_worker stdout | 2020-07-23 07:16:00,366 [101] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:16:00,366 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:16:30 UTC)" executed successfully builder stdout | 2020-07-23 07:16:00,530 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:16:01,419 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:16:01,431 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:16:01,431 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:16:01,530 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:16:02,530 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 securityworker stdout | 2020-07-23 07:16:03,477 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run securityworker stdout | 2020-07-23 07:16:03,478 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:16:33.476607+00:00 (in 29.998913 seconds) 2020-07-23 07:16:03,478 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:16:33 UTC)" (scheduled at 2020-07-23 07:16:03.476607+00:00) 2020-07-23 07:16:03,478 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:16:33 UTC)" executed successfully builder stdout | 2020-07-23 07:16:03,531 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 exportactionlogsworker stdout | 2020-07-23 07:16:03,974 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:16:03,975 [99] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:17:03 UTC)" (scheduled at 2020-07-23 07:16:03.971686+00:00) 2020-07-23 07:16:03,975 [99] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2020-07-23 07:16:03,977 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:16:08.212267+00:00 (in 4.237082 seconds) exportactionlogsworker stdout | 2020-07-23 07:16:03,979 [99] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 16, 3, 976027), True, datetime.datetime(2020, 7, 23, 7, 16, 3, 976027), 0, u'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2020-07-23 07:16:03,988 [99] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:16:03,989 [99] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2020-07-23 07:16:03,989 [99] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:17:03 UTC)" executed successfully builder stdout | 2020-07-23 07:16:04,531 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gcworker stdout | 2020-07-23 07:16:05,155 [110] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'gcworker.py', 'pid': '110'} expiredappspecifictokenworker stdout | 2020-07-23 07:16:05,520 [126] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '126'} builder stdout | 2020-07-23 07:16:05,531 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 securityworker stdout | 2020-07-23 07:16:06,190 [128] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'securityworker.py', 'pid': '128'} teamsyncworker stdout | 2020-07-23 07:16:06,507 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'teamsyncworker.py', 'pid': '115'} builder stdout | 2020-07-23 07:16:06,520 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 2020-07-23 07:16:06,521 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:16:05.531860 (running). builder stdout | 2020-07-23 07:16:06,531 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 namespacegcworker stdout | 2020-07-23 07:16:06,911 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:16:06,912 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:16:39.024941+00:00 (in 32.113113 seconds) 2020-07-23 07:16:06,912 [134] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:17:06 UTC)" (scheduled at 2020-07-23 07:16:06.910005+00:00) 2020-07-23 07:16:06,912 [134] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2020-07-23 07:16:06,915 [134] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 16, 6, 912843), True, datetime.datetime(2020, 7, 23, 7, 16, 6, 912843), 0, u'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2020-07-23 07:16:06,925 [134] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:16:06,925 [134] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:16:06,926 [134] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:17:06 UTC)" executed successfully builder stdout | 2020-07-23 07:16:07,532 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 exportactionlogsworker stdout | 2020-07-23 07:16:07,910 [99] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'exportactionlogsworker.py', 'pid': '99'} gunicorn-secscan stdout | 2020-07-23 07:16:08,010 [413] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '413'} gunicorn-secscan stdout | 2020-07-23 07:16:08,026 [412] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '412'} gunicorn-secscan stdout | 2020-07-23 07:16:08,051 [122] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '122'} gunicorn-secscan stdout | 2020-07-23 07:16:08,059 [411] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '411'} gunicorn-secscan stdout | 2020-07-23 07:16:08,064 [414] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '414'} exportactionlogsworker stdout | 2020-07-23 07:16:08,217 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:16:08,217 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:03.971686+00:00 (in 55.754203 seconds) 2020-07-23 07:16:08,218 [99] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:17:08 UTC)" (scheduled at 2020-07-23 07:16:08.212267+00:00) 2020-07-23 07:16:08,218 [99] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:16:08,218 [99] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:17:08 UTC)" executed successfully repositoryactioncounter stdout | 2020-07-23 07:16:08,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:16:08,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:16:18.291018+00:00 (in 9.998921 seconds) 2020-07-23 07:16:08,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:16:18 UTC)" (scheduled at 2020-07-23 07:16:08.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:16:08,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:16:08,302 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:16:08,303 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:16:08,303 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:16:18 UTC)" executed successfully queuecleanupworker stdout | 2020-07-23 07:16:08,340 [103] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'queuecleanupworker.py', 'pid': '103'} gunicorn-web stdout | 2020-07-23 07:16:08,383 [431] [DEBUG] [app] Starting request: urn:request:fefae7ea-04e9-4eb2-a484-420267b99ba4 (/health/instance) gunicorn-web stdout | 2020-07-23 07:16:08,385 [431] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:16:08,392 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:16:08,394 [470] [DEBUG] [app] Starting request: urn:request:bdfb831c-bff9-4023-85a2-dc90290c91d3 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:16:08,395 [470] [DEBUG] [app] Ending request: urn:request:bdfb831c-bff9-4023-85a2-dc90290c91d3 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:16:08,396 [470] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:08 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:08 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:16:08,397 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:16:08,398 [431] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:16:08,404 [431] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:16:08,412 [431] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:16:08,417 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:16:08,420 [419] [DEBUG] [app] Starting request: urn:request:a16fe270-faf3-482e-b7aa-66cecd6dff9e (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:16:08,421 [419] [DEBUG] [app] Ending request: urn:request:a16fe270-faf3-482e-b7aa-66cecd6dff9e (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:16:08,422 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:08 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:08 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:16:08,423 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:16:08,427 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:16:08,428 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:08 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:16:08,431 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:08 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:16:08,433 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:16:08,437 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:16:08,439 [458] [DEBUG] [app] Starting request: urn:request:74ac33d8-de9b-4f96-ad08-e3010081aede (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:16:08,440 [458] [DEBUG] [app] Ending request: urn:request:74ac33d8-de9b-4f96-ad08-e3010081aede (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:08 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:16:08,441 [458] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:08 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:16:08,442 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:16:08,444 [431] [DEBUG] [app] Ending request: urn:request:fefae7ea-04e9-4eb2-a484-420267b99ba4 (/health/instance) gunicorn-web stdout | 2020-07-23 07:16:08,445 [431] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:16:08,446 [431] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:16:08 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:16:08 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.065 49 0.065) builder stdout | 2020-07-23 07:16:08,532 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 globalpromstats stdout | 2020-07-23 07:16:09,192 [129] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'globalpromstats.py', 'pid': '129'} gunicorn-web stdout | 2020-07-23 07:16:09,384 [438] [DEBUG] [app] Starting request: urn:request:45b2cb2f-5f20-4511-bc3d-0bb8e9c9700a (/health/instance) gunicorn-web stdout | 2020-07-23 07:16:09,387 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:16:09,392 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:16:09,394 [467] [DEBUG] [app] Starting request: urn:request:f58f5ef3-155f-4d6c-bbce-f3a6895df65a (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:16:09,395 [467] [DEBUG] [app] Ending request: urn:request:f58f5ef3-155f-4d6c-bbce-f3a6895df65a (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:16:09,396 [467] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:16:09,397 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:16:09,398 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:16:09,404 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:16:09,412 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:16:09,417 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:16:09,419 [438] [DEBUG] [app] Starting request: urn:request:146ef9a3-f457-4666-b339-3d5811e5b28d (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:16:09,420 [438] [DEBUG] [app] Ending request: urn:request:146ef9a3-f457-4666-b339-3d5811e5b28d (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:16:09,421 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:16:09,421 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:16:09,425 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:09 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:16:09,426 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:16:09,429 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:09 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:16:09,431 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:16:09,435 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:16:09,437 [458] [DEBUG] [app] Starting request: urn:request:2ec27ffa-11e6-43aa-944d-3b9f8502879c (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:16:09,438 [458] [DEBUG] [app] Ending request: urn:request:2ec27ffa-11e6-43aa-944d-3b9f8502879c (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:09 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:16:09,439 [458] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:09 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:16:09,439 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:16:09,442 [438] [DEBUG] [app] Ending request: urn:request:45b2cb2f-5f20-4511-bc3d-0bb8e9c9700a (/health/instance) gunicorn-web stdout | 2020-07-23 07:16:09,442 [438] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:16:09,443 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:16:09 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:16:09 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.059 49 0.059) builder stdout | 2020-07-23 07:16:09,532 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 buildlogsarchiver stdout | 2020-07-23 07:16:09,550 [109] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'buildlogsarchiver.py', 'pid': '109'} notificationworker stdout | 2020-07-23 07:16:09,783 [113] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'notificationworker.py', 'pid': '113'} notificationworker stdout | 2020-07-23 07:16:09,914 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:16:09,915 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:16:11.998621+00:00 (in 2.083808 seconds) 2020-07-23 07:16:09,915 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:16:19 UTC)" (scheduled at 2020-07-23 07:16:09.911177+00:00) 2020-07-23 07:16:09,915 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:16:09,917 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 16, 9, 915737), True, datetime.datetime(2020, 7, 23, 7, 16, 9, 915737), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:16:09,927 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:16:09,927 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:16:09,928 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:16:19 UTC)" executed successfully chunkcleanupworker stdout | 2020-07-23 07:16:09,994 [124] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'chunkcleanupworker.py', 'pid': '124'} gcworker stdout | 2020-07-23 07:16:10,005 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2020-07-23 07:16:10,006 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:16:40.004697+00:00 (in 29.998755 seconds) 2020-07-23 07:16:10,006 [110] [INFO] [apscheduler.executors.default] Running job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:16:40 UTC)" (scheduled at 2020-07-23 07:16:10.004697+00:00) gcworker stdout | 2020-07-23 07:16:10,009 [110] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1594278970006, 1209600, 500, 1, 0]) gcworker stdout | 2020-07-23 07:16:10,019 [110] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2020-07-23 07:16:10,019 [110] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:16:10,019 [110] [INFO] [apscheduler.executors.default] Job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:16:40 UTC)" executed successfully builder stdout | 2020-07-23 07:16:10,532 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:16:11,281 [130] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'builder.py', 'pid': '130'} builder stdout | 2020-07-23 07:16:11,434 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:16:11,446 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:16:11,446 [130] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2020-07-23 07:16:11,511 [134] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'namespacegcworker.py', 'pid': '134'} repositorygcworker stdout | 2020-07-23 07:16:11,528 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositorygcworker.py', 'pid': '102'} builder stdout | 2020-07-23 07:16:11,533 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 blobuploadcleanupworker stdout | 2020-07-23 07:16:11,993 [119] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'blobuploadcleanupworker.py', 'pid': '119'} notificationworker stdout | 2020-07-23 07:16:11,999 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:16:11,999 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:16:19.911177+00:00 (in 7.911600 seconds) 2020-07-23 07:16:12,000 [113] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:17:11 UTC)" (scheduled at 2020-07-23 07:16:11.998621+00:00) 2020-07-23 07:16:12,000 [113] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2020-07-23 07:16:12,000 [113] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:17:11 UTC)" executed successfully builder stdout | 2020-07-23 07:16:12,533 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 security_notification_worker stdout | 2020-07-23 07:16:13,483 [101] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'security_notification_worker.py', 'pid': '101'} storagereplication stdout | 2020-07-23 07:16:13,517 [133] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'storagereplication.py', 'pid': '133'} builder stdout | 2020-07-23 07:16:13,533 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 logrotateworker stdout | 2020-07-23 07:16:13,535 [118] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'logrotateworker.py', 'pid': '118'} builder stdout | 2020-07-23 07:16:14,533 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:16:14,845 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositoryactioncounter.py', 'pid': '114'} servicekey stdout | 2020-07-23 07:16:15,520 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'servicekeyworker.py', 'pid': '98'} builder stdout | 2020-07-23 07:16:15,533 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:16:15,885 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '104'} gunicorn-web stdout | 2020-07-23 07:16:15,898 [435] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '435'} gunicorn-web stdout | 2020-07-23 07:16:15,927 [419] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '419'} gunicorn-web stdout | 2020-07-23 07:16:15,939 [438] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '438'} gunicorn-web stdout | 2020-07-23 07:16:15,943 [433] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '433'} gunicorn-web stdout | 2020-07-23 07:16:15,947 [431] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '431'} gunicorn-web stdout | 2020-07-23 07:16:15,957 [436] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '436'} gunicorn-web stdout | 2020-07-23 07:16:15,975 [420] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '420'} gunicorn-web stdout | 2020-07-23 07:16:15,982 [423] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '423'} builder stdout | 2020-07-23 07:16:16,522 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:16:16,523 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:16:15.534141 (running). builder stdout | 2020-07-23 07:16:16,534 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:16:17,534 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:16:18,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:16:18,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:16:28.291018+00:00 (in 9.999100 seconds) 2020-07-23 07:16:18,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:16:28 UTC)" (scheduled at 2020-07-23 07:16:18.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:16:18,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:16:18,303 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:16:18,304 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:16:18,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:16:28 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:16:18,383 [436] [DEBUG] [app] Starting request: urn:request:342fbae6-d188-4148-a0b2-ae915e6b04a1 (/health/instance) gunicorn-web stdout | 2020-07-23 07:16:18,386 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:16:18,391 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:16:18,392 [463] [DEBUG] [app] Starting request: urn:request:f69f0bda-4e54-41f7-ac97-d1d8c9462add (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:16:18,393 [463] [DEBUG] [app] Ending request: urn:request:f69f0bda-4e54-41f7-ac97-d1d8c9462add (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:18 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-registry stdout | 2020-07-23 07:16:18,394 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:18 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:16:18,394 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:16:18,395 [436] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:16:18,401 [436] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:16:18,410 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:16:18,415 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:16:18,417 [431] [DEBUG] [app] Starting request: urn:request:33e73df9-934a-448f-bab0-bc7da4bd388b (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:16:18,418 [431] [DEBUG] [app] Ending request: urn:request:33e73df9-934a-448f-bab0-bc7da4bd388b (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:18 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:16:18,418 [431] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:18 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:16:18,419 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:16:18,422 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:18 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:16:18,423 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:16:18,426 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:16:18,427 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:18 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:16:18,432 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:16:18,434 [459] [DEBUG] [app] Starting request: urn:request:4ed44440-f2c9-406e-9ace-a6bb31828b36 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:18 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 162 0.002) gunicorn-verbs stdout | 2020-07-23 07:16:18,435 [459] [DEBUG] [app] Ending request: urn:request:4ed44440-f2c9-406e-9ace-a6bb31828b36 (/c1/_internal_ping) 2020-07-23 07:16:18,435 [459] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:18 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:16:18,436 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:16:18,438 [436] [DEBUG] [app] Ending request: urn:request:342fbae6-d188-4148-a0b2-ae915e6b04a1 (/health/instance) 2020-07-23 07:16:18,438 [436] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:16:18 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.058 49 0.058) gunicorn-web stdout | 2020-07-23 07:16:18,439 [436] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:16:18 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" builder stdout | 2020-07-23 07:16:18,534 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:16:19,385 [438] [DEBUG] [app] Starting request: urn:request:fd1a3f77-601d-4330-aa66-5b1fd899102a (/health/instance) gunicorn-web stdout | 2020-07-23 07:16:19,387 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:16:19,393 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:16:19,395 [472] [DEBUG] [app] Starting request: urn:request:336eee33-d552-4665-b94f-274edaa0d53a (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:16:19,396 [472] [DEBUG] [app] Ending request: urn:request:336eee33-d552-4665-b94f-274edaa0d53a (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:16:19,397 [472] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:19 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:16:19,398 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:19 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:16:19,399 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:16:19,405 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:16:19,413 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:16:19,418 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:16:19,420 [438] [DEBUG] [app] Starting request: urn:request:581e1605-5671-4911-89e8-c8184375a742 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:16:19,421 [438] [DEBUG] [app] Ending request: urn:request:581e1605-5671-4911-89e8-c8184375a742 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:16:19,421 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:19 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:19 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:16:19,422 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:16:19,425 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:19 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:16:19,426 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:16:19,429 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:16:19,431 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:19 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:16:19,434 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:16:19,436 [459] [DEBUG] [app] Starting request: urn:request:f6fdc9cf-4711-4572-8608-edf09fcca29f (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:16:19,438 [459] [DEBUG] [app] Ending request: urn:request:f6fdc9cf-4711-4572-8608-edf09fcca29f (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:19 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:16:19,439 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:16:19,439 [459] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:19 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:16:19,440 [438] [DEBUG] [app] Ending request: urn:request:fd1a3f77-601d-4330-aa66-5b1fd899102a (/health/instance) gunicorn-web stdout | 2020-07-23 07:16:19,441 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:16:19,441 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:16:19 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:16:19 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.058 49 0.058) builder stdout | 2020-07-23 07:16:19,534 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:16:19,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:16:19,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:16:29.911177+00:00 (in 9.999094 seconds) 2020-07-23 07:16:19,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:16:29 UTC)" (scheduled at 2020-07-23 07:16:19.911177+00:00) 2020-07-23 07:16:19,912 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:16:19,914 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 16, 19, 912919), True, datetime.datetime(2020, 7, 23, 7, 16, 19, 912919), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:16:19,924 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:16:19,924 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:16:19,924 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:16:29 UTC)" executed successfully builder stdout | 2020-07-23 07:16:20,535 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:16:20,851 [130] [DEBUG] [buildman.server] Writing metrics builder stdout | 2020-07-23 07:16:20,865 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds builder stdout | 2020-07-23 07:16:21,448 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:16:21,454 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:16:21,454 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:16:21,535 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositorygcworker stdout | 2020-07-23 07:16:21,739 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:16:21,740 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:16:28.907644+00:00 (in 7.167524 seconds) 2020-07-23 07:16:21,740 [102] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:17:21 UTC)" (scheduled at 2020-07-23 07:16:21.739118+00:00) 2020-07-23 07:16:21,740 [102] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2020-07-23 07:16:21,743 [102] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 16, 21, 741069), True, datetime.datetime(2020, 7, 23, 7, 16, 21, 741069), 0, u'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2020-07-23 07:16:21,751 [102] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2020-07-23 07:16:21,751 [102] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:16:21,751 [102] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:17:21 UTC)" executed successfully builder stdout | 2020-07-23 07:16:22,535 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-registry stdout | 2020-07-23 07:16:22,613 [469] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '469'} gunicorn-registry stdout | 2020-07-23 07:16:22,628 [100] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '100'} gunicorn-registry stdout | 2020-07-23 07:16:22,658 [463] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '463'} gunicorn-registry stdout | 2020-07-23 07:16:22,671 [477] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '477'} gunicorn-registry stdout | 2020-07-23 07:16:22,688 [478] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '478'} gunicorn-registry stdout | 2020-07-23 07:16:22,694 [470] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '470'} gunicorn-registry stdout | 2020-07-23 07:16:22,705 [476] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '476'} gunicorn-registry stdout | 2020-07-23 07:16:22,716 [480] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '480'} gunicorn-registry stdout | 2020-07-23 07:16:22,729 [467] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '467'} gunicorn-registry stdout | 2020-07-23 07:16:22,740 [475] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '475'} gunicorn-registry stdout | 2020-07-23 07:16:22,759 [479] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '479'} gunicorn-registry stdout | 2020-07-23 07:16:22,776 [474] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '474'} gunicorn-registry stdout | 2020-07-23 07:16:22,789 [472] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '472'} gunicorn-registry stdout | 2020-07-23 07:16:22,794 [465] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '465'} gunicorn-registry stdout | 2020-07-23 07:16:22,808 [473] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '473'} gunicorn-registry stdout | 2020-07-23 07:16:22,823 [471] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '471'} gunicorn-registry stdout | 2020-07-23 07:16:22,828 [481] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '481'} builder stdout | 2020-07-23 07:16:23,536 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:16:24,536 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-verbs stdout | 2020-07-23 07:16:24,580 [127] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'verbs:application', 'pid': '127'} builder stdout | 2020-07-23 07:16:25,536 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 buildlogsarchiver stdout | 2020-07-23 07:16:26,396 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:16:26,396 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:16:26 UTC)" (scheduled at 2020-07-23 07:16:26.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:16:26,397 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:16:56.395393+00:00 (in 29.998803 seconds) buildlogsarchiver stdout | 2020-07-23 07:16:26,398 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 16, 26, 397585), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:16:26,407 [109] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2020-07-23 07:16:26,407 [109] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:16:26,407 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:16:56 UTC)" executed successfully builder stdout | 2020-07-23 07:16:26,524 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:16:26,525 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:16:25.536673 (running). builder stdout | 2020-07-23 07:16:26,536 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:16:27,536 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:16:28,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:16:28,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:16:38.291018+00:00 (in 9.999167 seconds) repositoryactioncounter stdout | 2020-07-23 07:16:28,295 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:16:38 UTC)" (scheduled at 2020-07-23 07:16:28.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:16:28,298 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:16:28,307 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:16:28,307 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:16:28,307 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:16:38 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:16:28,382 [419] [DEBUG] [app] Starting request: urn:request:7916b6b8-e233-48f8-8a11-957f1211fdc2 (/health/instance) gunicorn-web stdout | 2020-07-23 07:16:28,385 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:16:28,390 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:16:28,392 [477] [DEBUG] [app] Starting request: urn:request:b6b5c254-926e-4e56-8725-fb3bc1e0daa9 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:16:28,393 [477] [DEBUG] [app] Ending request: urn:request:b6b5c254-926e-4e56-8725-fb3bc1e0daa9 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:28 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-registry stdout | 2020-07-23 07:16:28,394 [477] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:28 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:16:28,394 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:16:28,395 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:16:28,401 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:16:28,408 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:16:28,413 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:16:28,415 [438] [DEBUG] [app] Starting request: urn:request:a801e792-0deb-4fd2-a3b5-1a9c14980c76 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:16:28,416 [438] [DEBUG] [app] Ending request: urn:request:a801e792-0deb-4fd2-a3b5-1a9c14980c76 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:16:28,417 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:28 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:16:28,417 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:28 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:16:28,422 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:16:28,423 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:28 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:16:28,427 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:28 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:16:28,428 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:16:28,433 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:16:28,435 [459] [DEBUG] [app] Starting request: urn:request:3f9804c0-7507-4945-840f-4ddcf322792c (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:16:28,436 [459] [DEBUG] [app] Ending request: urn:request:3f9804c0-7507-4945-840f-4ddcf322792c (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:28 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:16:28,437 [459] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:28 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:16:28,437 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:16:28,439 [419] [DEBUG] [app] Ending request: urn:request:7916b6b8-e233-48f8-8a11-957f1211fdc2 (/health/instance) gunicorn-web stdout | 2020-07-23 07:16:28,440 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:16:28,440 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:16:28 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:16:28 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.060 49 0.060) builder stdout | 2020-07-23 07:16:28,536 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositorygcworker stdout | 2020-07-23 07:16:28,908 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:16:28,909 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:06.904189+00:00 (in 37.995486 seconds) 2020-07-23 07:16:28,909 [102] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:17:28 UTC)" (scheduled at 2020-07-23 07:16:28.907644+00:00) 2020-07-23 07:16:28,909 [102] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:16:28,909 [102] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:17:28 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:16:29,384 [438] [DEBUG] [app] Starting request: urn:request:b1c165d8-3752-4da8-a11c-3f2ba7788723 (/health/instance) gunicorn-web stdout | 2020-07-23 07:16:29,387 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:16:29,393 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:16:29,395 [463] [DEBUG] [app] Starting request: urn:request:182d8ff3-9d18-458b-bfb7-006e6587569f (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:16:29,396 [463] [DEBUG] [app] Ending request: urn:request:182d8ff3-9d18-458b-bfb7-006e6587569f (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:16:29,397 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:29 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:29 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:16:29,399 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:16:29,401 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:16:29,406 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:16:29,416 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:16:29,421 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:16:29,422 [438] [DEBUG] [app] Starting request: urn:request:04112a44-08e5-4a8f-bac6-6e95496883b7 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:16:29,424 [438] [DEBUG] [app] Ending request: urn:request:04112a44-08e5-4a8f-bac6-6e95496883b7 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:29 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:16:29,424 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:29 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:16:29,425 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:16:29,428 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:16:29,429 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:29 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:16:29,432 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:16:29,434 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:29 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:16:29,438 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:16:29,440 [466] [DEBUG] [app] Starting request: urn:request:6b4c7c97-eccc-41ac-9b03-14953d24d0f6 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:16:29,441 [466] [DEBUG] [app] Ending request: urn:request:6b4c7c97-eccc-41ac-9b03-14953d24d0f6 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:16:29,442 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:29 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:29 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:16:29,443 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:16:29,445 [438] [DEBUG] [app] Ending request: urn:request:b1c165d8-3752-4da8-a11c-3f2ba7788723 (/health/instance) gunicorn-web stdout | 2020-07-23 07:16:29,445 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:16:29,446 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:16:29 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:16:29 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.065 49 0.065) builder stdout | 2020-07-23 07:16:29,537 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:16:29,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:16:29,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:16:39.911177+00:00 (in 9.999021 seconds) 2020-07-23 07:16:29,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:16:39 UTC)" (scheduled at 2020-07-23 07:16:29.911177+00:00) 2020-07-23 07:16:29,912 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:16:29,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 16, 29, 913091), True, datetime.datetime(2020, 7, 23, 7, 16, 29, 913091), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:16:29,924 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:16:29,924 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:16:29,925 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:16:39 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:16:30,368 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:16:30,369 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:16:52.446816+00:00 (in 22.077789 seconds) 2020-07-23 07:16:30,373 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:17:00 UTC)" (scheduled at 2020-07-23 07:16:30.351857+00:00) 2020-07-23 07:16:30,373 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:16:30,412 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 16, 30, 373435), True, datetime.datetime(2020, 7, 23, 7, 16, 30, 373435), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:16:30,424 [101] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:16:30,425 [101] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:16:30,425 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:17:00 UTC)" executed successfully builder stdout | 2020-07-23 07:16:30,537 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:16:31,456 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:16:31,469 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:16:31,469 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:16:31,538 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:16:32,538 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 securityworker stdout | 2020-07-23 07:16:33,477 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run securityworker stdout | 2020-07-23 07:16:33,478 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:17:03 UTC)" (scheduled at 2020-07-23 07:16:33.476607+00:00) 2020-07-23 07:16:33,478 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:03.476607+00:00 (in 29.999010 seconds) securityworker stdout | 2020-07-23 07:16:33,478 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:17:03 UTC)" executed successfully builder stdout | 2020-07-23 07:16:33,538 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:16:34,538 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gcworker stdout | 2020-07-23 07:16:35,189 [110] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'gcworker.py', 'pid': '110'} builder stdout | 2020-07-23 07:16:35,538 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 expiredappspecifictokenworker stdout | 2020-07-23 07:16:35,560 [126] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '126'} securityworker stdout | 2020-07-23 07:16:36,230 [128] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'securityworker.py', 'pid': '128'} builder stdout | 2020-07-23 07:16:36,526 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:16:36,527 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:16:35.538949 (running). builder stdout | 2020-07-23 07:16:36,539 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 teamsyncworker stdout | 2020-07-23 07:16:36,546 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'teamsyncworker.py', 'pid': '115'} builder stdout | 2020-07-23 07:16:37,539 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 exportactionlogsworker stdout | 2020-07-23 07:16:37,949 [99] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'exportactionlogsworker.py', 'pid': '99'} gunicorn-secscan stdout | 2020-07-23 07:16:38,021 [413] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '413'} gunicorn-secscan stdout | 2020-07-23 07:16:38,038 [412] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '412'} gunicorn-secscan stdout | 2020-07-23 07:16:38,062 [122] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '122'} gunicorn-secscan stdout | 2020-07-23 07:16:38,071 [411] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '411'} gunicorn-secscan stdout | 2020-07-23 07:16:38,075 [414] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '414'} repositoryactioncounter stdout | 2020-07-23 07:16:38,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:16:38,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:16:48.291018+00:00 (in 9.999069 seconds) 2020-07-23 07:16:38,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:16:48 UTC)" (scheduled at 2020-07-23 07:16:38.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:16:38,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:16:38,303 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:16:38,303 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:16:38,303 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:16:48 UTC)" executed successfully queuecleanupworker stdout | 2020-07-23 07:16:38,353 [103] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'queuecleanupworker.py', 'pid': '103'} gunicorn-web stdout | 2020-07-23 07:16:38,382 [419] [DEBUG] [app] Starting request: urn:request:318a7c1c-7cb3-4a80-9680-87f44dff4c53 (/health/instance) gunicorn-web stdout | 2020-07-23 07:16:38,385 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:16:38,390 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:16:38,393 [474] [DEBUG] [app] Starting request: urn:request:4f274cdd-5d1b-455a-80c9-54dd297f8a3e (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:16:38,394 [474] [DEBUG] [app] Ending request: urn:request:4f274cdd-5d1b-455a-80c9-54dd297f8a3e (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:16:38,395 [474] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:38 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:38 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:16:38,395 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:16:38,397 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:16:38,403 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:16:38,411 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:16:38,417 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:16:38,419 [419] [DEBUG] [app] Starting request: urn:request:83e6033f-ee2e-4480-b64f-8fb0c00cacfd (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:16:38,420 [419] [DEBUG] [app] Ending request: urn:request:83e6033f-ee2e-4480-b64f-8fb0c00cacfd (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:16:38,421 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:38 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:16:38,421 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:38 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:16:38,425 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:38 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:16:38,426 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:16:38,429 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:38 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:16:38,432 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:16:38,436 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:16:38,438 [459] [DEBUG] [app] Starting request: urn:request:a4431b7c-6644-4847-aaba-daf5c45e04ba (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:16:38,439 [459] [DEBUG] [app] Ending request: urn:request:a4431b7c-6644-4847-aaba-daf5c45e04ba (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:16:38,440 [459] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:38 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:38 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:16:38,441 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:16:38,442 [419] [DEBUG] [app] Ending request: urn:request:318a7c1c-7cb3-4a80-9680-87f44dff4c53 (/health/instance) gunicorn-web stdout | 2020-07-23 07:16:38,443 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:16:38,443 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:16:38 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:16:38 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.063 49 0.063) builder stdout | 2020-07-23 07:16:38,539 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 namespacegcworker stdout | 2020-07-23 07:16:39,025 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:16:39,026 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:06.910005+00:00 (in 27.884066 seconds) 2020-07-23 07:16:39,026 [134] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:17:39 UTC)" (scheduled at 2020-07-23 07:16:39.024941+00:00) 2020-07-23 07:16:39,027 [134] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2020-07-23 07:16:39,027 [134] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:17:39 UTC)" executed successfully globalpromstats stdout | 2020-07-23 07:16:39,233 [129] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'globalpromstats.py', 'pid': '129'} gunicorn-web stdout | 2020-07-23 07:16:39,384 [419] [DEBUG] [app] Starting request: urn:request:29a0eb56-841f-4bc7-bbfe-a83faab8de39 (/health/instance) gunicorn-web stdout | 2020-07-23 07:16:39,388 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:16:39,390 [472] [DEBUG] [app] Starting request: urn:request:29850d1e-cd83-49e9-96de-cac2ac618907 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:16:39,391 [472] [DEBUG] [app] Ending request: urn:request:29850d1e-cd83-49e9-96de-cac2ac618907 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:16:39,392 [472] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:16:39,392 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 162 0.002) gunicorn-web stdout | 2020-07-23 07:16:39,393 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:16:39,399 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:16:39,407 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:16:39,412 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:16:39,414 [419] [DEBUG] [app] Starting request: urn:request:574b49d8-6811-4c49-acb7-2d662b1f7d67 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:16:39,415 [419] [DEBUG] [app] Ending request: urn:request:574b49d8-6811-4c49-acb7-2d662b1f7d67 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:16:39,416 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 159 0.002) gunicorn-web stdout | 2020-07-23 07:16:39,416 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:16:39,420 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:39 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:16:39,422 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:16:39,425 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:16:39,426 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:39 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:16:39,431 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:16:39,433 [468] [DEBUG] [app] Starting request: urn:request:6e70c594-7ef5-408b-b36c-c58d614da562 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:16:39,434 [468] [DEBUG] [app] Ending request: urn:request:6e70c594-7ef5-408b-b36c-c58d614da562 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:16:39,436 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:39 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-verbs stdout | 2020-07-23 07:16:39,435 [468] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:39 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:16:39,438 [419] [DEBUG] [app] Ending request: urn:request:29a0eb56-841f-4bc7-bbfe-a83faab8de39 (/health/instance) 2020-07-23 07:16:39,438 [419] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:16:39 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.057 49 0.057) gunicorn-web stdout | 2020-07-23 07:16:39,439 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:16:39 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" builder stdout | 2020-07-23 07:16:39,539 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 buildlogsarchiver stdout | 2020-07-23 07:16:39,588 [109] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'buildlogsarchiver.py', 'pid': '109'} notificationworker stdout | 2020-07-23 07:16:39,819 [113] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'notificationworker.py', 'pid': '113'} notificationworker stdout | 2020-07-23 07:16:39,913 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:16:39,914 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:16:49.911177+00:00 (in 9.997132 seconds) 2020-07-23 07:16:39,915 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:16:49 UTC)" (scheduled at 2020-07-23 07:16:39.911177+00:00) notificationworker stdout | 2020-07-23 07:16:39,915 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:16:39,918 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 16, 39, 915507), True, datetime.datetime(2020, 7, 23, 7, 16, 39, 915507), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:16:39,927 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:16:39,927 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:16:39,927 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:16:49 UTC)" executed successfully gcworker stdout | 2020-07-23 07:16:40,005 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2020-07-23 07:16:40,006 [110] [INFO] [apscheduler.executors.default] Running job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:17:10 UTC)" (scheduled at 2020-07-23 07:16:40.004697+00:00) gcworker stdout | 2020-07-23 07:16:40,007 [110] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."removed_tag_expiration_s" FROM "user" AS "t1" LIMIT %s', [100]) 2020-07-23 07:16:40,007 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:10.004697+00:00 (in 29.999059 seconds) gcworker stdout | 2020-07-23 07:16:40,016 [110] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1594279000014, 1209600, 500, 1, 0]) gcworker stdout | 2020-07-23 07:16:40,021 [110] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2020-07-23 07:16:40,021 [110] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:16:40,021 [110] [INFO] [apscheduler.executors.default] Job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:17:10 UTC)" executed successfully chunkcleanupworker stdout | 2020-07-23 07:16:40,033 [124] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'chunkcleanupworker.py', 'pid': '124'} builder stdout | 2020-07-23 07:16:40,539 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:16:41,324 [130] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'builder.py', 'pid': '130'} builder stdout | 2020-07-23 07:16:41,471 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:16:41,484 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:16:41,484 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:16:41,540 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 namespacegcworker stdout | 2020-07-23 07:16:41,543 [134] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'namespacegcworker.py', 'pid': '134'} repositorygcworker stdout | 2020-07-23 07:16:41,567 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositorygcworker.py', 'pid': '102'} blobuploadcleanupworker stdout | 2020-07-23 07:16:42,031 [119] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'blobuploadcleanupworker.py', 'pid': '119'} builder stdout | 2020-07-23 07:16:42,540 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 security_notification_worker stdout | 2020-07-23 07:16:43,524 [101] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'security_notification_worker.py', 'pid': '101'} builder stdout | 2020-07-23 07:16:43,540 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 storagereplication stdout | 2020-07-23 07:16:43,556 [133] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'storagereplication.py', 'pid': '133'} logrotateworker stdout | 2020-07-23 07:16:43,573 [118] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'logrotateworker.py', 'pid': '118'} builder stdout | 2020-07-23 07:16:44,540 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:16:44,882 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositoryactioncounter.py', 'pid': '114'} builder stdout | 2020-07-23 07:16:45,541 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 servicekey stdout | 2020-07-23 07:16:45,559 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'servicekeyworker.py', 'pid': '98'} gunicorn-web stdout | 2020-07-23 07:16:45,898 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '104'} gunicorn-web stdout | 2020-07-23 07:16:45,909 [435] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '435'} gunicorn-web stdout | 2020-07-23 07:16:45,942 [419] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '419'} gunicorn-web stdout | 2020-07-23 07:16:45,956 [433] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '433'} gunicorn-web stdout | 2020-07-23 07:16:45,962 [438] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '438'} gunicorn-web stdout | 2020-07-23 07:16:45,967 [431] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '431'} gunicorn-web stdout | 2020-07-23 07:16:45,973 [436] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '436'} gunicorn-web stdout | 2020-07-23 07:16:45,987 [420] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '420'} gunicorn-web stdout | 2020-07-23 07:16:45,995 [423] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '423'} builder stdout | 2020-07-23 07:16:46,528 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 2020-07-23 07:16:46,529 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:16:45.541220 (running). builder stdout | 2020-07-23 07:16:46,541 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:16:47,541 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:16:48,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:16:48,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:16:58.291018+00:00 (in 9.998856 seconds) 2020-07-23 07:16:48,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:16:58 UTC)" (scheduled at 2020-07-23 07:16:48.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:16:48,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:16:48,305 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:16:48,305 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:16:48,305 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:16:58 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:16:48,382 [438] [DEBUG] [app] Starting request: urn:request:8ee2038d-f5b8-4dae-af3d-8148f34c966b (/health/instance) gunicorn-web stdout | 2020-07-23 07:16:48,385 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:16:48,390 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:16:48,391 [474] [DEBUG] [app] Starting request: urn:request:50504a95-b34f-43d4-973e-862fec8b5a1e (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:16:48,392 [474] [DEBUG] [app] Ending request: urn:request:50504a95-b34f-43d4-973e-862fec8b5a1e (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:16:48,393 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:16:48,395 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2020-07-23 07:16:48,396 [474] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:16:48,401 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:16:48,410 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:16:48,415 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:16:48,417 [438] [DEBUG] [app] Starting request: urn:request:392d5874-8e7d-49b1-9fe7-f9ced160cfc9 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:16:48,418 [438] [DEBUG] [app] Ending request: urn:request:392d5874-8e7d-49b1-9fe7-f9ced160cfc9 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:16:48,419 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:48 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:48 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:16:48,419 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:16:48,424 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:48 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:16:48,425 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:16:48,428 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:16:48,429 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:48 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:16:48,434 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:16:48,436 [458] [DEBUG] [app] Starting request: urn:request:58d4bc46-e3e0-4033-9a12-799162d3a324 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:16:48,437 [458] [DEBUG] [app] Ending request: urn:request:58d4bc46-e3e0-4033-9a12-799162d3a324 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:16:48,438 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:48 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:16:48,437 [458] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:48 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:16:48,440 [438] [DEBUG] [app] Ending request: urn:request:8ee2038d-f5b8-4dae-af3d-8148f34c966b (/health/instance) gunicorn-web stdout | 2020-07-23 07:16:48,440 [438] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:16:48,441 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:16:48 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:16:48 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.060 49 0.060) builder stdout | 2020-07-23 07:16:48,541 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:16:49,384 [419] [DEBUG] [app] Starting request: urn:request:d892f17c-6b87-4e0c-a4e0-1c0b9bfddae2 (/health/instance) gunicorn-web stdout | 2020-07-23 07:16:49,387 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:16:49,392 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:16:49,394 [474] [DEBUG] [app] Starting request: urn:request:709367e6-b02c-4e7c-89c2-c7366785e9e4 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:16:49,395 [474] [DEBUG] [app] Ending request: urn:request:709367e6-b02c-4e7c-89c2-c7366785e9e4 (/v1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:16:49,396 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:49 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:16:49,398 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2020-07-23 07:16:49,396 [474] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:49 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:16:49,405 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:16:49,412 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:16:49,417 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:16:49,419 [419] [DEBUG] [app] Starting request: urn:request:ee260507-e8e5-4483-be65-cb86621f4026 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:16:49,420 [419] [DEBUG] [app] Ending request: urn:request:ee260507-e8e5-4483-be65-cb86621f4026 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:49 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:16:49,421 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:49 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:16:49,421 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:16:49,425 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:16:49,426 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:49 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:16:49,430 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:49 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:16:49,432 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:16:49,436 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:16:49,438 [459] [DEBUG] [app] Starting request: urn:request:a377f6b5-93e2-4a77-8f74-eb346a6a4cef (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:16:49,439 [459] [DEBUG] [app] Ending request: urn:request:a377f6b5-93e2-4a77-8f74-eb346a6a4cef (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:16:49,440 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:49 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 162 0.002) gunicorn-verbs stdout | 2020-07-23 07:16:49,440 [459] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:49 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:16:49,441 [419] [DEBUG] [app] Ending request: urn:request:d892f17c-6b87-4e0c-a4e0-1c0b9bfddae2 (/health/instance) 2020-07-23 07:16:49,442 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:16:49,442 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:16:49 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:16:49 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.061 49 0.061) builder stdout | 2020-07-23 07:16:49,542 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:16:49,912 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:16:49,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:16:59.911177+00:00 (in 9.998821 seconds) 2020-07-23 07:16:49,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:16:59 UTC)" (scheduled at 2020-07-23 07:16:49.911177+00:00) 2020-07-23 07:16:49,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. 2020-07-23 07:16:49,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 16, 49, 913218), True, datetime.datetime(2020, 7, 23, 7, 16, 49, 913218), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:16:49,924 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:16:49,924 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:16:49,924 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:16:59 UTC)" executed successfully builder stdout | 2020-07-23 07:16:50,542 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:16:50,866 [130] [DEBUG] [buildman.server] Writing metrics builder stdout | 2020-07-23 07:16:50,881 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds builder stdout | 2020-07-23 07:16:51,486 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:16:51,494 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:16:51,494 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:16:51,542 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 security_notification_worker stdout | 2020-07-23 07:16:52,447 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:16:52,447 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:00.351857+00:00 (in 7.904250 seconds) 2020-07-23 07:16:52,448 [101] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:17:52 UTC)" (scheduled at 2020-07-23 07:16:52.446816+00:00) 2020-07-23 07:16:52,448 [101] [DEBUG] [workers.queueworker] Running watchdog. security_notification_worker stdout | 2020-07-23 07:16:52,448 [101] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:17:52 UTC)" executed successfully builder stdout | 2020-07-23 07:16:52,542 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-registry stdout | 2020-07-23 07:16:52,626 [469] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '469'} gunicorn-registry stdout | 2020-07-23 07:16:52,639 [100] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '100'} gunicorn-registry stdout | 2020-07-23 07:16:52,673 [463] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '463'} gunicorn-registry stdout | 2020-07-23 07:16:52,683 [477] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '477'} gunicorn-registry stdout | 2020-07-23 07:16:52,700 [478] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '478'} gunicorn-registry stdout | 2020-07-23 07:16:52,710 [470] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '470'} gunicorn-registry stdout | 2020-07-23 07:16:52,722 [476] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '476'} gunicorn-registry stdout | 2020-07-23 07:16:52,731 [480] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '480'} gunicorn-registry stdout | 2020-07-23 07:16:52,748 [467] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '467'} gunicorn-registry stdout | 2020-07-23 07:16:52,755 [475] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '475'} gunicorn-registry stdout | 2020-07-23 07:16:52,772 [479] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '479'} gunicorn-registry stdout | 2020-07-23 07:16:52,793 [474] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '474'} gunicorn-registry stdout | 2020-07-23 07:16:52,811 [472] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '472'} gunicorn-registry stdout | 2020-07-23 07:16:52,817 [465] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '465'} gunicorn-registry stdout | 2020-07-23 07:16:52,828 [473] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '473'} gunicorn-registry stdout | 2020-07-23 07:16:52,838 [471] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '471'} gunicorn-registry stdout | 2020-07-23 07:16:52,843 [481] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '481'} builder stdout | 2020-07-23 07:16:53,542 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:16:54,543 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-verbs stdout | 2020-07-23 07:16:54,689 [127] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'verbs:application', 'pid': '127'} builder stdout | 2020-07-23 07:16:55,543 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 buildlogsarchiver stdout | 2020-07-23 07:16:56,398 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:16:56,398 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:17:26 UTC)" (scheduled at 2020-07-23 07:16:56.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:16:56,400 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 16, 56, 399095), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:16:56,401 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:26.395393+00:00 (in 29.997031 seconds) buildlogsarchiver stdout | 2020-07-23 07:16:56,410 [109] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2020-07-23 07:16:56,410 [109] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:16:56,410 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:17:26 UTC)" executed successfully builder stdout | 2020-07-23 07:16:56,530 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 2020-07-23 07:16:56,531 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:16:55.543710 (running). builder stdout | 2020-07-23 07:16:56,543 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:16:57,544 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:16:58,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:16:58,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:08.291018+00:00 (in 9.999071 seconds) 2020-07-23 07:16:58,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:17:08 UTC)" (scheduled at 2020-07-23 07:16:58.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:16:58,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:16:58,304 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:16:58,304 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:16:58,305 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:17:08 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:16:58,383 [435] [DEBUG] [app] Starting request: urn:request:67f12ed5-b156-4913-9800-1abd2b0711bc (/health/instance) gunicorn-web stdout | 2020-07-23 07:16:58,385 [435] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:16:58,391 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:16:58,393 [477] [DEBUG] [app] Starting request: urn:request:b2cefe7a-7f03-455b-9530-90a48ef918a3 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:16:58,394 [477] [DEBUG] [app] Ending request: urn:request:b2cefe7a-7f03-455b-9530-90a48ef918a3 (/v1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:16:58,395 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:16:58,397 [435] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2020-07-23 07:16:58,398 [477] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:16:58,403 [435] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:16:58,411 [435] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:16:58,416 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:16:58,419 [433] [DEBUG] [app] Starting request: urn:request:46fb0845-dc61-4c16-85b6-085692640250 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:16:58,420 [433] [DEBUG] [app] Ending request: urn:request:46fb0845-dc61-4c16-85b6-085692640250 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:58 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:16:58,421 [433] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:58 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:16:58,422 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:16:58,426 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:58 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:16:58,427 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:16:58,430 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:58 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.002 153 0.002) gunicorn-web stdout | 2020-07-23 07:16:58,432 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:16:58,436 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:16:58,438 [459] [DEBUG] [app] Starting request: urn:request:0b1fb3d2-a3d5-49b7-88cd-ff98ec745330 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:16:58,439 [459] [DEBUG] [app] Ending request: urn:request:0b1fb3d2-a3d5-49b7-88cd-ff98ec745330 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:16:58,440 [459] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:58 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:16:58,441 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:58 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:16:58,442 [435] [DEBUG] [app] Ending request: urn:request:67f12ed5-b156-4913-9800-1abd2b0711bc (/health/instance) 2020-07-23 07:16:58,442 [435] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:16:58,443 [435] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:16:58 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:16:58 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.063 49 0.063) builder stdout | 2020-07-23 07:16:58,544 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:16:59,384 [419] [DEBUG] [app] Starting request: urn:request:c4f04f8f-a206-4f3b-a8fc-aad6aa86a62e (/health/instance) gunicorn-web stdout | 2020-07-23 07:16:59,387 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:16:59,393 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:16:59,395 [463] [DEBUG] [app] Starting request: urn:request:d46dfbdf-00de-437c-a065-1e161153a12c (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:16:59,396 [463] [DEBUG] [app] Ending request: urn:request:d46dfbdf-00de-437c-a065-1e161153a12c (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:59 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-registry stdout | 2020-07-23 07:16:59,397 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:59 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:16:59,398 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:16:59,399 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:16:59,405 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:16:59,414 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:16:59,419 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:16:59,421 [419] [DEBUG] [app] Starting request: urn:request:80887aab-b4c0-4051-b93d-e2c03d006f41 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:16:59,422 [419] [DEBUG] [app] Ending request: urn:request:80887aab-b4c0-4051-b93d-e2c03d006f41 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:16:59,423 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:59 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:59 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:16:59,424 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:16:59,427 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:59 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:16:59,428 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:16:59,432 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:59 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:16:59,433 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:16:59,437 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:16:59,439 [466] [DEBUG] [app] Starting request: urn:request:1e84c652-92bb-49d1-9233-34d0b4cb78e2 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:16:59,440 [466] [DEBUG] [app] Ending request: urn:request:1e84c652-92bb-49d1-9233-34d0b4cb78e2 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:16:59,441 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:16:59 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:16:59,441 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:16:59 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:16:59,443 [419] [DEBUG] [app] Ending request: urn:request:c4f04f8f-a206-4f3b-a8fc-aad6aa86a62e (/health/instance) 2020-07-23 07:16:59,443 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:16:59,444 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:16:59 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:16:59 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.061 49 0.061) builder stdout | 2020-07-23 07:16:59,544 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:16:59,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:16:59,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:09.911177+00:00 (in 9.998992 seconds) 2020-07-23 07:16:59,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:17:09 UTC)" (scheduled at 2020-07-23 07:16:59.911177+00:00) 2020-07-23 07:16:59,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:16:59,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 16, 59, 913125), True, datetime.datetime(2020, 7, 23, 7, 16, 59, 913125), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:16:59,925 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:16:59,925 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:16:59,925 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:17:09 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:17:00,353 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:17:00,353 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:30.351857+00:00 (in 29.998316 seconds) 2020-07-23 07:17:00,354 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:17:30 UTC)" (scheduled at 2020-07-23 07:17:00.351857+00:00) 2020-07-23 07:17:00,354 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:17:00,356 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 17, 0, 354635), True, datetime.datetime(2020, 7, 23, 7, 17, 0, 354635), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:17:00,365 [101] [DEBUG] [workers.queueworker] No more work. security_notification_worker stdout | 2020-07-23 07:17:00,365 [101] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:17:00,365 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:17:30 UTC)" executed successfully builder stdout | 2020-07-23 07:17:00,544 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:17:01,495 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:17:01,507 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:17:01,507 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:17:01,544 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:17:02,545 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 securityworker stdout | 2020-07-23 07:17:03,477 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run securityworker stdout | 2020-07-23 07:17:03,478 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:33.476607+00:00 (in 29.998443 seconds) 2020-07-23 07:17:03,478 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:17:33 UTC)" (scheduled at 2020-07-23 07:17:03.476607+00:00) securityworker stdout | 2020-07-23 07:17:03,479 [128] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "image" AS "t1" WHERE ("t1"."security_indexed_engine" < %s)', [3]) securityworker stdout | 2020-07-23 07:17:03,487 [128] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "image" AS "t1"', []) securityworker stdout | 2020-07-23 07:17:03,488 [128] [DEBUG] [data.secscan_model.secscan_v2_model] Found no additional images to scan 2020-07-23 07:17:03,488 [128] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:17:03,489 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:17:33 UTC)" executed successfully builder stdout | 2020-07-23 07:17:03,545 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 exportactionlogsworker stdout | 2020-07-23 07:17:03,972 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:17:03,972 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:08.212267+00:00 (in 4.239611 seconds) 2020-07-23 07:17:03,973 [99] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:18:03 UTC)" (scheduled at 2020-07-23 07:17:03.971686+00:00) 2020-07-23 07:17:03,973 [99] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2020-07-23 07:17:03,975 [99] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 17, 3, 973692), True, datetime.datetime(2020, 7, 23, 7, 17, 3, 973692), 0, u'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2020-07-23 07:17:03,984 [99] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2020-07-23 07:17:03,984 [99] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:17:03,985 [99] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:18:03 UTC)" executed successfully builder stdout | 2020-07-23 07:17:04,545 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gcworker stdout | 2020-07-23 07:17:05,229 [110] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'gcworker.py', 'pid': '110'} builder stdout | 2020-07-23 07:17:05,545 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 expiredappspecifictokenworker stdout | 2020-07-23 07:17:05,598 [126] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '126'} securityworker stdout | 2020-07-23 07:17:06,263 [128] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'securityworker.py', 'pid': '128'} builder stdout | 2020-07-23 07:17:06,532 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 2020-07-23 07:17:06,533 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:17:05.545878 (running). builder stdout | 2020-07-23 07:17:06,546 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 teamsyncworker stdout | 2020-07-23 07:17:06,584 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'teamsyncworker.py', 'pid': '115'} repositorygcworker stdout | 2020-07-23 07:17:06,904 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:17:06,905 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:21.739118+00:00 (in 14.834031 seconds) repositorygcworker stdout | 2020-07-23 07:17:06,905 [102] [INFO] [apscheduler.executors.default] Running job "update_queue_metrics (trigger: interval[0:05:00], next run at: 2020-07-23 07:22:06 UTC)" (scheduled at 2020-07-23 07:17:06.904189+00:00) repositorygcworker stdout | 2020-07-23 07:17:06,908 [102] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2020, 7, 23, 7, 17, 6, 907007), u'repositorygc/%']) namespacegcworker stdout | 2020-07-23 07:17:06,911 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:17:06,912 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:23.024302+00:00 (in 16.112176 seconds) 2020-07-23 07:17:06,912 [134] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:18:06 UTC)" (scheduled at 2020-07-23 07:17:06.910005+00:00) 2020-07-23 07:17:06,912 [134] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2020-07-23 07:17:06,915 [134] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 17, 6, 912993), True, datetime.datetime(2020, 7, 23, 7, 17, 6, 912993), 0, u'namespacegc/%', 50, 1, 0]) repositorygcworker stdout | 2020-07-23 07:17:06,919 [102] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2020, 7, 23, 7, 17, 6, 907007), True, datetime.datetime(2020, 7, 23, 7, 17, 6, 907007), 0, u'repositorygc/%']) repositorygcworker stdout | 2020-07-23 07:17:06,923 [102] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2020, 7, 23, 7, 17, 6, 907007), True, datetime.datetime(2020, 7, 23, 7, 17, 6, 907007), 0, u'repositorygc/%', False, datetime.datetime(2020, 7, 23, 7, 17, 6, 907007), u'repositorygc/%']) repositorygcworker stdout | 2020-07-23 07:17:06,926 [102] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:17:06,927 [102] [INFO] [apscheduler.executors.default] Job "update_queue_metrics (trigger: interval[0:05:00], next run at: 2020-07-23 07:22:06 UTC)" executed successfully namespacegcworker stdout | 2020-07-23 07:17:06,931 [134] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2020-07-23 07:17:06,932 [134] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:17:06,932 [134] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:18:06 UTC)" executed successfully builder stdout | 2020-07-23 07:17:07,546 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 exportactionlogsworker stdout | 2020-07-23 07:17:07,987 [99] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'exportactionlogsworker.py', 'pid': '99'} gunicorn-secscan stdout | 2020-07-23 07:17:08,034 [413] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '413'} gunicorn-secscan stdout | 2020-07-23 07:17:08,048 [412] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '412'} gunicorn-secscan stdout | 2020-07-23 07:17:08,075 [122] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '122'} gunicorn-secscan stdout | 2020-07-23 07:17:08,083 [411] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '411'} gunicorn-secscan stdout | 2020-07-23 07:17:08,088 [414] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '414'} exportactionlogsworker stdout | 2020-07-23 07:17:08,213 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:17:08,213 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:18:03.971686+00:00 (in 55.758261 seconds) 2020-07-23 07:17:08,214 [99] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:18:08 UTC)" (scheduled at 2020-07-23 07:17:08.212267+00:00) 2020-07-23 07:17:08,214 [99] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:17:08,214 [99] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:18:08 UTC)" executed successfully repositoryactioncounter stdout | 2020-07-23 07:17:08,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:17:08,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:17:08 UTC)" (scheduled at 2020-07-23 07:17:08.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:17:08,294 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:18.291018+00:00 (in 9.999105 seconds) repositoryactioncounter stdout | 2020-07-23 07:17:08,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:17:08,304 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:17:08,304 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:17:08,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:17:18 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:17:08,383 [419] [DEBUG] [app] Starting request: urn:request:d685e9b9-53ed-489a-a103-558be7aba0da (/health/instance) 2020-07-23 07:17:08,386 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:17:08,393 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) queuecleanupworker stdout | 2020-07-23 07:17:08,394 [103] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'queuecleanupworker.py', 'pid': '103'} gunicorn-registry stdout | 2020-07-23 07:17:08,396 [463] [DEBUG] [app] Starting request: urn:request:e7903174-0a29-4141-a8c2-74a2e2cb27b9 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:17:08,397 [463] [DEBUG] [app] Ending request: urn:request:e7903174-0a29-4141-a8c2-74a2e2cb27b9 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:17:08,398 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:08 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:08 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:17:08,398 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:17:08,400 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:17:08,406 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:17:08,415 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:17:08,422 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:17:08,424 [431] [DEBUG] [app] Starting request: urn:request:a271fe42-178e-4b9e-8c30-672d52229072 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:17:08,425 [431] [DEBUG] [app] Ending request: urn:request:a271fe42-178e-4b9e-8c30-672d52229072 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:17:08,426 [431] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:08 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:08 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:17:08,427 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:17:08,431 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:17:08,432 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:08 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:17:08,436 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:08 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:17:08,437 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:17:08,442 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:17:08,444 [466] [DEBUG] [app] Starting request: urn:request:3aaffd15-ad9b-4994-b722-149dc08559b2 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:17:08,445 [466] [DEBUG] [app] Ending request: urn:request:3aaffd15-ad9b-4994-b722-149dc08559b2 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:08 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:17:08,446 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:08 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:17:08,447 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:17:08,449 [419] [DEBUG] [app] Ending request: urn:request:d685e9b9-53ed-489a-a103-558be7aba0da (/health/instance) 2020-07-23 07:17:08,449 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:17:08,450 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:17:08 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:17:08 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.069 49 0.069) builder stdout | 2020-07-23 07:17:08,546 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 globalpromstats stdout | 2020-07-23 07:17:09,273 [129] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'globalpromstats.py', 'pid': '129'} gunicorn-web stdout | 2020-07-23 07:17:09,385 [419] [DEBUG] [app] Starting request: urn:request:528ac73d-622f-467f-8b20-77bd6593e3d3 (/health/instance) gunicorn-web stdout | 2020-07-23 07:17:09,389 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:17:09,391 [481] [DEBUG] [app] Starting request: urn:request:9e7eba88-7e1a-41fa-a733-09b9b3bee059 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:17:09,392 [481] [DEBUG] [app] Ending request: urn:request:9e7eba88-7e1a-41fa-a733-09b9b3bee059 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-registry stdout | 2020-07-23 07:17:09,393 [481] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:17:09,393 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:17:09,394 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:17:09,400 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:17:09,408 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:17:09,413 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:17:09,415 [419] [DEBUG] [app] Starting request: urn:request:99a342fa-1d49-4a88-8ec3-b6decc06aff2 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:17:09,416 [419] [DEBUG] [app] Ending request: urn:request:99a342fa-1d49-4a88-8ec3-b6decc06aff2 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:17:09,417 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:17:09,418 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:17:09,421 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:09 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:17:09,422 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:17:09,425 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:09 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:17:09,427 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:17:09,432 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:17:09,434 [458] [DEBUG] [app] Starting request: urn:request:6d062e0f-2104-4e72-8a4b-e0db3d9eb07e (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:17:09,435 [458] [DEBUG] [app] Ending request: urn:request:6d062e0f-2104-4e72-8a4b-e0db3d9eb07e (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:09 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:17:09,436 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:17:09,436 [458] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:09 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:17:09,438 [419] [DEBUG] [app] Ending request: urn:request:528ac73d-622f-467f-8b20-77bd6593e3d3 (/health/instance) gunicorn-web stdout | 2020-07-23 07:17:09,438 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:17:09,439 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:17:09 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:17:09 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.056 49 0.056) builder stdout | 2020-07-23 07:17:09,546 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 buildlogsarchiver stdout | 2020-07-23 07:17:09,629 [109] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'buildlogsarchiver.py', 'pid': '109'} notificationworker stdout | 2020-07-23 07:17:09,857 [113] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'notificationworker.py', 'pid': '113'} notificationworker stdout | 2020-07-23 07:17:09,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:17:09,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:17:19 UTC)" (scheduled at 2020-07-23 07:17:09.911177+00:00) 2020-07-23 07:17:09,912 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:17:09,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 17, 9, 913140), True, datetime.datetime(2020, 7, 23, 7, 17, 9, 913140), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:17:09,916 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:11.998621+00:00 (in 2.086530 seconds) notificationworker stdout | 2020-07-23 07:17:09,925 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:17:09,925 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:17:09,925 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:17:19 UTC)" executed successfully gcworker stdout | 2020-07-23 07:17:10,007 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2020-07-23 07:17:10,007 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:40.004697+00:00 (in 29.997442 seconds) 2020-07-23 07:17:10,008 [110] [INFO] [apscheduler.executors.default] Running job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:17:40 UTC)" (scheduled at 2020-07-23 07:17:10.004697+00:00) gcworker stdout | 2020-07-23 07:17:10,010 [110] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1594279030008, 1209600, 500, 1, 0]) gcworker stdout | 2020-07-23 07:17:10,020 [110] [DEBUG] [__main__] No repository with garbage found 2020-07-23 07:17:10,021 [110] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2020-07-23 07:17:10,021 [110] [INFO] [apscheduler.executors.default] Job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:17:40 UTC)" executed successfully chunkcleanupworker stdout | 2020-07-23 07:17:10,072 [124] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'chunkcleanupworker.py', 'pid': '124'} builder stdout | 2020-07-23 07:17:10,547 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:17:11,362 [130] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'builder.py', 'pid': '130'} builder stdout | 2020-07-23 07:17:11,508 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:17:11,523 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:17:11,523 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:17:11,547 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 namespacegcworker stdout | 2020-07-23 07:17:11,564 [134] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'namespacegcworker.py', 'pid': '134'} repositorygcworker stdout | 2020-07-23 07:17:11,607 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositorygcworker.py', 'pid': '102'} notificationworker stdout | 2020-07-23 07:17:12,002 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:17:12,003 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:19.911177+00:00 (in 7.907952 seconds) 2020-07-23 07:17:12,003 [113] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:18:11 UTC)" (scheduled at 2020-07-23 07:17:11.998621+00:00) 2020-07-23 07:17:12,004 [113] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2020-07-23 07:17:12,004 [113] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:18:11 UTC)" executed successfully blobuploadcleanupworker stdout | 2020-07-23 07:17:12,065 [119] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'blobuploadcleanupworker.py', 'pid': '119'} builder stdout | 2020-07-23 07:17:12,547 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:17:13,547 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 security_notification_worker stdout | 2020-07-23 07:17:13,563 [101] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'security_notification_worker.py', 'pid': '101'} storagereplication stdout | 2020-07-23 07:17:13,595 [133] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'storagereplication.py', 'pid': '133'} logrotateworker stdout | 2020-07-23 07:17:13,613 [118] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'logrotateworker.py', 'pid': '118'} builder stdout | 2020-07-23 07:17:14,547 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:17:14,915 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositoryactioncounter.py', 'pid': '114'} builder stdout | 2020-07-23 07:17:15,548 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 servicekey stdout | 2020-07-23 07:17:15,593 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'servicekeyworker.py', 'pid': '98'} gunicorn-web stdout | 2020-07-23 07:17:15,909 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '104'} gunicorn-web stdout | 2020-07-23 07:17:15,921 [435] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '435'} gunicorn-web stdout | 2020-07-23 07:17:15,955 [419] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '419'} gunicorn-web stdout | 2020-07-23 07:17:15,970 [433] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '433'} gunicorn-web stdout | 2020-07-23 07:17:15,982 [431] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '431'} gunicorn-web stdout | 2020-07-23 07:17:15,987 [438] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '438'} gunicorn-web stdout | 2020-07-23 07:17:15,992 [436] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '436'} gunicorn-web stdout | 2020-07-23 07:17:15,999 [420] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '420'} gunicorn-web stdout | 2020-07-23 07:17:16,007 [423] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '423'} builder stdout | 2020-07-23 07:17:16,533 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 2020-07-23 07:17:16,534 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:17:15.548349 (running). builder stdout | 2020-07-23 07:17:16,548 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:17:17,548 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:17:18,294 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:17:18,295 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:28.291018+00:00 (in 9.996048 seconds) 2020-07-23 07:17:18,295 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:17:28 UTC)" (scheduled at 2020-07-23 07:17:18.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:17:18,297 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:17:18,307 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:17:18,307 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:17:18,308 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:17:28 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:17:18,382 [438] [DEBUG] [app] Starting request: urn:request:1097c2c5-0830-4c6c-acc2-8fcfe4be69d2 (/health/instance) gunicorn-web stdout | 2020-07-23 07:17:18,384 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:17:18,389 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:17:18,391 [479] [DEBUG] [app] Starting request: urn:request:1726fbe1-5a3b-4dbe-9eb3-792609490e69 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:17:18,393 [479] [DEBUG] [app] Ending request: urn:request:1726fbe1-5a3b-4dbe-9eb3-792609490e69 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:18 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-registry stdout | 2020-07-23 07:17:18,393 [479] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:18 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:17:18,394 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:17:18,395 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:17:18,401 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:17:18,410 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:17:18,416 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:17:18,418 [438] [DEBUG] [app] Starting request: urn:request:889c13e8-2a39-4b48-a3ef-c04ef8bdf411 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:17:18,419 [438] [DEBUG] [app] Ending request: urn:request:889c13e8-2a39-4b48-a3ef-c04ef8bdf411 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:17:18,420 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:18 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:18 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:17:18,420 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:17:18,425 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:18 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:17:18,426 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:17:18,430 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:18 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:17:18,431 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:17:18,436 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:17:18,438 [466] [DEBUG] [app] Starting request: urn:request:df12d053-be9d-4d78-8cdb-d909f3f4b14d (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:17:18,439 [466] [DEBUG] [app] Ending request: urn:request:df12d053-be9d-4d78-8cdb-d909f3f4b14d (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:18 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:17:18,440 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:18 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:17:18,441 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:17:18,443 [438] [DEBUG] [app] Ending request: urn:request:1097c2c5-0830-4c6c-acc2-8fcfe4be69d2 (/health/instance) 2020-07-23 07:17:18,443 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:17:18,444 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:17:18 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:17:18 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.064 49 0.064) builder stdout | 2020-07-23 07:17:18,548 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:17:19,384 [438] [DEBUG] [app] Starting request: urn:request:147b474d-0d32-4963-afac-24efccb1faf5 (/health/instance) gunicorn-web stdout | 2020-07-23 07:17:19,388 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:17:19,390 [463] [DEBUG] [app] Starting request: urn:request:f1e716d8-ed94-41cf-8498-bb924f9bdd09 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:17:19,391 [463] [DEBUG] [app] Ending request: urn:request:f1e716d8-ed94-41cf-8498-bb924f9bdd09 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:17:19,392 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:19 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:19 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:17:19,392 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:17:19,393 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:17:19,398 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:17:19,406 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:17:19,412 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:17:19,414 [438] [DEBUG] [app] Starting request: urn:request:0d71b45c-457e-4e1f-8c3f-9b056ad7f2b3 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:17:19,415 [438] [DEBUG] [app] Ending request: urn:request:0d71b45c-457e-4e1f-8c3f-9b056ad7f2b3 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:19 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:17:19,416 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:19 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:17:19,416 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:17:19,420 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:19 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:17:19,421 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:17:19,424 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:17:19,425 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:19 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:17:19,430 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:17:19,431 [466] [DEBUG] [app] Starting request: urn:request:2ba86ccb-0d33-4eda-9aa6-2c03d18d1dea (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:17:19,433 [466] [DEBUG] [app] Ending request: urn:request:2ba86ccb-0d33-4eda-9aa6-2c03d18d1dea (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:17:19,433 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:19 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:19 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.005 162 0.005) gunicorn-web stdout | 2020-07-23 07:17:19,435 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:17:19,437 [438] [DEBUG] [app] Ending request: urn:request:147b474d-0d32-4963-afac-24efccb1faf5 (/health/instance) gunicorn-web stdout | 2020-07-23 07:17:19,438 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:17:19,438 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:17:19 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:17:19 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.056 49 0.056) builder stdout | 2020-07-23 07:17:19,549 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:17:19,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:17:19,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:29.911177+00:00 (in 9.998972 seconds) 2020-07-23 07:17:19,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:17:29 UTC)" (scheduled at 2020-07-23 07:17:19.911177+00:00) 2020-07-23 07:17:19,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:17:19,916 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 17, 19, 913210), True, datetime.datetime(2020, 7, 23, 7, 17, 19, 913210), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:17:19,927 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:17:19,927 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:17:19,927 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:17:29 UTC)" executed successfully builder stdout | 2020-07-23 07:17:20,549 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:17:20,883 [130] [DEBUG] [buildman.server] Writing metrics builder stdout | 2020-07-23 07:17:20,896 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds builder stdout | 2020-07-23 07:17:21,524 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:17:21,531 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:17:21,531 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:17:21,549 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositorygcworker stdout | 2020-07-23 07:17:21,740 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:17:21,740 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:28.907644+00:00 (in 7.167358 seconds) 2020-07-23 07:17:21,741 [102] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:18:21 UTC)" (scheduled at 2020-07-23 07:17:21.739118+00:00) 2020-07-23 07:17:21,741 [102] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2020-07-23 07:17:21,743 [102] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 17, 21, 741430), True, datetime.datetime(2020, 7, 23, 7, 17, 21, 741430), 0, u'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2020-07-23 07:17:21,751 [102] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2020-07-23 07:17:21,751 [102] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:17:21,751 [102] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:18:21 UTC)" executed successfully builder stdout | 2020-07-23 07:17:22,549 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-registry stdout | 2020-07-23 07:17:22,638 [469] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '469'} gunicorn-registry stdout | 2020-07-23 07:17:22,650 [100] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '100'} gunicorn-registry stdout | 2020-07-23 07:17:22,686 [463] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '463'} gunicorn-registry stdout | 2020-07-23 07:17:22,697 [477] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '477'} gunicorn-registry stdout | 2020-07-23 07:17:22,714 [478] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '478'} gunicorn-registry stdout | 2020-07-23 07:17:22,723 [470] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '470'} gunicorn-registry stdout | 2020-07-23 07:17:22,740 [476] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '476'} gunicorn-registry stdout | 2020-07-23 07:17:22,747 [480] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '480'} gunicorn-registry stdout | 2020-07-23 07:17:22,768 [467] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '467'} gunicorn-registry stdout | 2020-07-23 07:17:22,774 [475] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '475'} gunicorn-registry stdout | 2020-07-23 07:17:22,785 [479] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '479'} gunicorn-registry stdout | 2020-07-23 07:17:22,806 [474] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '474'} gunicorn-registry stdout | 2020-07-23 07:17:22,829 [472] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '472'} gunicorn-registry stdout | 2020-07-23 07:17:22,834 [465] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '465'} gunicorn-registry stdout | 2020-07-23 07:17:22,840 [473] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '473'} gunicorn-registry stdout | 2020-07-23 07:17:22,854 [471] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '471'} gunicorn-registry stdout | 2020-07-23 07:17:22,858 [481] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '481'} namespacegcworker stdout | 2020-07-23 07:17:23,025 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:17:23,025 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:39.024941+00:00 (in 15.999662 seconds) 2020-07-23 07:17:23,025 [134] [INFO] [apscheduler.executors.default] Running job "update_queue_metrics (trigger: interval[0:05:00], next run at: 2020-07-23 07:22:23 UTC)" (scheduled at 2020-07-23 07:17:23.024302+00:00) namespacegcworker stdout | 2020-07-23 07:17:23,027 [134] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2020, 7, 23, 7, 17, 23, 26189), u'namespacegc/%']) namespacegcworker stdout | 2020-07-23 07:17:23,036 [134] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2020, 7, 23, 7, 17, 23, 26189), True, datetime.datetime(2020, 7, 23, 7, 17, 23, 26189), 0, u'namespacegc/%']) namespacegcworker stdout | 2020-07-23 07:17:23,039 [134] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2020, 7, 23, 7, 17, 23, 26189), True, datetime.datetime(2020, 7, 23, 7, 17, 23, 26189), 0, u'namespacegc/%', False, datetime.datetime(2020, 7, 23, 7, 17, 23, 26189), u'namespacegc/%']) namespacegcworker stdout | 2020-07-23 07:17:23,041 [134] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2020-07-23 07:17:23,041 [134] [INFO] [apscheduler.executors.default] Job "update_queue_metrics (trigger: interval[0:05:00], next run at: 2020-07-23 07:22:23 UTC)" executed successfully builder stdout | 2020-07-23 07:17:23,550 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:17:24,550 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-verbs stdout | 2020-07-23 07:17:24,799 [127] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'verbs:application', 'pid': '127'} builder stdout | 2020-07-23 07:17:25,550 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 buildlogsarchiver stdout | 2020-07-23 07:17:26,398 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:17:26,399 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:56.395393+00:00 (in 29.996189 seconds) 2020-07-23 07:17:26,399 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:17:56 UTC)" (scheduled at 2020-07-23 07:17:26.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:17:26,401 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 17, 26, 400121), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:17:26,410 [109] [DEBUG] [__main__] No more builds to archive 2020-07-23 07:17:26,410 [109] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2020-07-23 07:17:26,410 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:17:56 UTC)" executed successfully builder stdout | 2020-07-23 07:17:26,535 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 2020-07-23 07:17:26,536 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:17:25.550784 (running). builder stdout | 2020-07-23 07:17:26,550 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:17:27,550 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:17:28,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:17:28,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:38.291018+00:00 (in 9.999153 seconds) 2020-07-23 07:17:28,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:17:38 UTC)" (scheduled at 2020-07-23 07:17:28.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:17:28,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:17:28,303 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:17:28,303 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:17:28,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:17:38 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:17:28,382 [419] [DEBUG] [app] Starting request: urn:request:138d8bf9-07d1-49dc-ad41-0370593b5f37 (/health/instance) gunicorn-web stdout | 2020-07-23 07:17:28,385 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:17:28,390 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:17:28,393 [480] [DEBUG] [app] Starting request: urn:request:92cf5cce-bd6c-4a57-b24a-cef3a6b51962 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:17:28,394 [480] [DEBUG] [app] Ending request: urn:request:92cf5cce-bd6c-4a57-b24a-cef3a6b51962 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:28 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-registry stdout | 2020-07-23 07:17:28,395 [480] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:28 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:17:28,395 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:17:28,396 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:17:28,401 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:17:28,409 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:17:28,413 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:17:28,415 [419] [DEBUG] [app] Starting request: urn:request:c674c4f7-9ca2-4d53-af1d-a3c8c7781d44 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:17:28,416 [419] [DEBUG] [app] Ending request: urn:request:c674c4f7-9ca2-4d53-af1d-a3c8c7781d44 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:17:28,417 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:28 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:28 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:17:28,418 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:17:28,422 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:28 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:17:28,423 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:17:28,427 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:17:28,428 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:28 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:17:28,432 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:17:28,434 [466] [DEBUG] [app] Starting request: urn:request:aa1efe33-2418-4194-a969-5a479b894888 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:17:28,436 [466] [DEBUG] [app] Ending request: urn:request:aa1efe33-2418-4194-a969-5a479b894888 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:17:28,436 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:28 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.005 162 0.005) gunicorn-verbs stdout | 2020-07-23 07:17:28,437 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:28 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:17:28,438 [419] [DEBUG] [app] Ending request: urn:request:138d8bf9-07d1-49dc-ad41-0370593b5f37 (/health/instance) 2020-07-23 07:17:28,439 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:17:28,439 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:17:28 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:17:28 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.059 49 0.059) builder stdout | 2020-07-23 07:17:28,551 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositorygcworker stdout | 2020-07-23 07:17:28,908 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:17:28,909 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:18:21.739118+00:00 (in 52.830191 seconds) 2020-07-23 07:17:28,909 [102] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:18:28 UTC)" (scheduled at 2020-07-23 07:17:28.907644+00:00) 2020-07-23 07:17:28,909 [102] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:17:28,909 [102] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:18:28 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:17:29,385 [438] [DEBUG] [app] Starting request: urn:request:c2f56f31-b137-466e-b58e-530e858d1a49 (/health/instance) gunicorn-web stdout | 2020-07-23 07:17:29,387 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:17:29,392 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:17:29,394 [479] [DEBUG] [app] Starting request: urn:request:32eb89b4-2935-43bf-9d75-684b99989c42 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:17:29,396 [479] [DEBUG] [app] Ending request: urn:request:32eb89b4-2935-43bf-9d75-684b99989c42 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:17:29,397 [479] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:29 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:29 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:17:29,397 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:17:29,398 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:17:29,404 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:17:29,413 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:17:29,418 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:17:29,420 [419] [DEBUG] [app] Starting request: urn:request:b0720966-0dca-4a5a-99d6-702879137acb (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:17:29,421 [419] [DEBUG] [app] Ending request: urn:request:b0720966-0dca-4a5a-99d6-702879137acb (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:17:29,421 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:29 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:17:29,421 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:29 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:17:29,425 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:29 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:17:29,426 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:17:29,430 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:29 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:17:29,432 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:17:29,437 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:17:29,439 [458] [DEBUG] [app] Starting request: urn:request:2c37d243-f3c5-456f-9817-0717b65a87d8 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:29 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-verbs stdout | 2020-07-23 07:17:29,440 [458] [DEBUG] [app] Ending request: urn:request:2c37d243-f3c5-456f-9817-0717b65a87d8 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:17:29,441 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:17:29,441 [458] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:29 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:17:29,443 [438] [DEBUG] [app] Ending request: urn:request:c2f56f31-b137-466e-b58e-530e858d1a49 (/health/instance) 2020-07-23 07:17:29,443 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:17:29,444 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:17:29 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:17:29 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.060 49 0.060) builder stdout | 2020-07-23 07:17:29,551 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:17:29,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:17:29,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:39.911177+00:00 (in 9.999048 seconds) 2020-07-23 07:17:29,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:17:39 UTC)" (scheduled at 2020-07-23 07:17:29.911177+00:00) 2020-07-23 07:17:29,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:17:29,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 17, 29, 913195), True, datetime.datetime(2020, 7, 23, 7, 17, 29, 913195), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:17:29,924 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:17:29,924 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:17:29,925 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:17:39 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:17:30,352 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:17:30,353 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:52.446816+00:00 (in 22.093653 seconds) 2020-07-23 07:17:30,353 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:18:00 UTC)" (scheduled at 2020-07-23 07:17:30.351857+00:00) 2020-07-23 07:17:30,354 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:17:30,356 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 17, 30, 354162), True, datetime.datetime(2020, 7, 23, 7, 17, 30, 354162), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:17:30,364 [101] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:17:30,364 [101] [DEBUG] [data.database] Disconnecting from database. security_notification_worker stdout | 2020-07-23 07:17:30,364 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:18:00 UTC)" executed successfully builder stdout | 2020-07-23 07:17:30,551 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:17:31,532 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:17:31,544 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:17:31,544 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:17:31,551 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:17:32,568 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 securityworker stdout | 2020-07-23 07:17:33,477 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run securityworker stdout | 2020-07-23 07:17:33,478 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:18:03 UTC)" (scheduled at 2020-07-23 07:17:33.476607+00:00) 2020-07-23 07:17:33,478 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:18:03 UTC)" executed successfully securityworker stdout | 2020-07-23 07:17:33,478 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:18:03.476607+00:00 (in 29.998980 seconds) builder stdout | 2020-07-23 07:17:33,552 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:17:34,552 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gcworker stdout | 2020-07-23 07:17:35,259 [110] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'gcworker.py', 'pid': '110'} builder stdout | 2020-07-23 07:17:35,552 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 expiredappspecifictokenworker stdout | 2020-07-23 07:17:35,627 [126] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '126'} securityworker stdout | 2020-07-23 07:17:36,294 [128] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'securityworker.py', 'pid': '128'} builder stdout | 2020-07-23 07:17:36,537 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:17:36,538 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:17:35.553134 (running). builder stdout | 2020-07-23 07:17:36,553 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 teamsyncworker stdout | 2020-07-23 07:17:36,623 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'teamsyncworker.py', 'pid': '115'} builder stdout | 2020-07-23 07:17:37,553 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 exportactionlogsworker stdout | 2020-07-23 07:17:38,027 [99] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'exportactionlogsworker.py', 'pid': '99'} gunicorn-secscan stdout | 2020-07-23 07:17:38,045 [413] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '413'} gunicorn-secscan stdout | 2020-07-23 07:17:38,060 [412] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '412'} gunicorn-secscan stdout | 2020-07-23 07:17:38,084 [122] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '122'} gunicorn-secscan stdout | 2020-07-23 07:17:38,092 [411] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '411'} gunicorn-secscan stdout | 2020-07-23 07:17:38,099 [414] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '414'} repositoryactioncounter stdout | 2020-07-23 07:17:38,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:17:38,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:48.291018+00:00 (in 9.999188 seconds) 2020-07-23 07:17:38,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:17:48 UTC)" (scheduled at 2020-07-23 07:17:38.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:17:38,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:17:38,303 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:17:38,303 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:17:38,303 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:17:48 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:17:38,383 [419] [DEBUG] [app] Starting request: urn:request:f40f850e-9e22-4757-b4fd-ab85ad39adf7 (/health/instance) gunicorn-web stdout | 2020-07-23 07:17:38,386 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:17:38,392 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:17:38,394 [481] [DEBUG] [app] Starting request: urn:request:704c2f2b-795a-4a85-83c4-28927971c5c7 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:17:38,395 [481] [DEBUG] [app] Ending request: urn:request:704c2f2b-795a-4a85-83c4-28927971c5c7 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:17:38,396 [481] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:38 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:17:38,396 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:38 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:17:38,397 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:17:38,404 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:17:38,412 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:17:38,417 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:17:38,419 [438] [DEBUG] [app] Starting request: urn:request:f533ad16-bbd0-4e18-87ef-95ac14c7cd68 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:17:38,420 [438] [DEBUG] [app] Ending request: urn:request:f533ad16-bbd0-4e18-87ef-95ac14c7cd68 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:17:38,421 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:38 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:38 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 159 0.002) gunicorn-web stdout | 2020-07-23 07:17:38,421 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:17:38,425 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) 2020-07-23 07:17:38,426 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:38 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:17:38,430 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:38 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:17:38,432 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:17:38,437 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:17:38,439 [462] [DEBUG] [app] Starting request: urn:request:4119b6b3-8872-4874-a7bf-ce010eefe703 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:17:38,441 [462] [DEBUG] [app] Ending request: urn:request:4119b6b3-8872-4874-a7bf-ce010eefe703 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:17:38,442 [462] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:38 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:38 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.005 162 0.005) gunicorn-web stdout | 2020-07-23 07:17:38,443 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:17:38,446 [419] [DEBUG] [app] Ending request: urn:request:f40f850e-9e22-4757-b4fd-ab85ad39adf7 (/health/instance) 2020-07-23 07:17:38,447 [419] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:17:38,448 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:17:38 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:17:38 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.067 49 0.067) queuecleanupworker stdout | 2020-07-23 07:17:38,451 [103] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'queuecleanupworker.py', 'pid': '103'} builder stdout | 2020-07-23 07:17:38,553 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 namespacegcworker stdout | 2020-07-23 07:17:39,025 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:17:39,026 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:18:06.910005+00:00 (in 27.884046 seconds) 2020-07-23 07:17:39,026 [134] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:18:39 UTC)" (scheduled at 2020-07-23 07:17:39.024941+00:00) 2020-07-23 07:17:39,026 [134] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:17:39,027 [134] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:18:39 UTC)" executed successfully globalpromstats stdout | 2020-07-23 07:17:39,311 [129] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'globalpromstats.py', 'pid': '129'} gunicorn-web stdout | 2020-07-23 07:17:39,384 [420] [DEBUG] [app] Starting request: urn:request:4be4af58-d89a-4b26-96c6-0030672a7e80 (/health/instance) gunicorn-web stdout | 2020-07-23 07:17:39,387 [420] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:17:39,392 [420] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:17:39,395 [477] [DEBUG] [app] Starting request: urn:request:21e32b7b-efcc-4702-ae21-a0c99496b432 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:17:39,396 [477] [DEBUG] [app] Ending request: urn:request:21e32b7b-efcc-4702-ae21-a0c99496b432 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:17:39,397 [477] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:17:39,397 [420] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:17:39,398 [420] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:17:39,404 [420] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:17:39,412 [420] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:17:39,418 [420] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:17:39,420 [420] [DEBUG] [app] Starting request: urn:request:a69dd099-e7e9-4217-84bf-cc18ad92c85b (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:17:39,421 [420] [DEBUG] [app] Ending request: urn:request:a69dd099-e7e9-4217-84bf-cc18ad92c85b (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:17:39,422 [420] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:17:39,422 [420] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:17:39,427 [420] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:39 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:17:39,428 [420] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:17:39,431 [420] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:17:39,432 [420] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:39 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:17:39,437 [420] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:17:39,438 [462] [DEBUG] [app] Starting request: urn:request:b66c8e9e-a159-4025-9830-58a2ef2fdc9e (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:17:39,439 [462] [DEBUG] [app] Ending request: urn:request:b66c8e9e-a159-4025-9830-58a2ef2fdc9e (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:39 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:17:39,440 [462] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:39 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:17:39,440 [420] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:17:39,442 [420] [DEBUG] [app] Ending request: urn:request:4be4af58-d89a-4b26-96c6-0030672a7e80 (/health/instance) gunicorn-web stdout | 2020-07-23 07:17:39,443 [420] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:17:39,443 [420] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:17:39 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:17:39 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.062 49 0.062) builder stdout | 2020-07-23 07:17:39,553 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 buildlogsarchiver stdout | 2020-07-23 07:17:39,669 [109] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'buildlogsarchiver.py', 'pid': '109'} notificationworker stdout | 2020-07-23 07:17:39,896 [113] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'notificationworker.py', 'pid': '113'} notificationworker stdout | 2020-07-23 07:17:39,912 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:17:39,913 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:49.911177+00:00 (in 9.998452 seconds) 2020-07-23 07:17:39,913 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:17:49 UTC)" (scheduled at 2020-07-23 07:17:39.911177+00:00) 2020-07-23 07:17:39,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:17:39,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 17, 39, 913702), True, datetime.datetime(2020, 7, 23, 7, 17, 39, 913702), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:17:39,924 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:17:39,925 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:17:39,925 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:17:49 UTC)" executed successfully gcworker stdout | 2020-07-23 07:17:40,005 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2020-07-23 07:17:40,006 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:18:10.004697+00:00 (in 29.998900 seconds) 2020-07-23 07:17:40,006 [110] [INFO] [apscheduler.executors.default] Running job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:18:10 UTC)" (scheduled at 2020-07-23 07:17:40.004697+00:00) gcworker stdout | 2020-07-23 07:17:40,008 [110] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1594279060006, 1209600, 500, 1, 0]) gcworker stdout | 2020-07-23 07:17:40,018 [110] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2020-07-23 07:17:40,019 [110] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:17:40,019 [110] [INFO] [apscheduler.executors.default] Job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:18:10 UTC)" executed successfully chunkcleanupworker stdout | 2020-07-23 07:17:40,112 [124] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'chunkcleanupworker.py', 'pid': '124'} builder stdout | 2020-07-23 07:17:40,554 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:17:41,402 [130] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'builder.py', 'pid': '130'} builder stdout | 2020-07-23 07:17:41,545 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:17:41,557 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:17:41,558 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:17:41,559 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 namespacegcworker stdout | 2020-07-23 07:17:41,603 [134] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'namespacegcworker.py', 'pid': '134'} repositorygcworker stdout | 2020-07-23 07:17:41,646 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositorygcworker.py', 'pid': '102'} blobuploadcleanupworker stdout | 2020-07-23 07:17:42,107 [119] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'blobuploadcleanupworker.py', 'pid': '119'} builder stdout | 2020-07-23 07:17:42,554 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:17:43,555 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 security_notification_worker stdout | 2020-07-23 07:17:43,603 [101] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'security_notification_worker.py', 'pid': '101'} storagereplication stdout | 2020-07-23 07:17:43,635 [133] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'storagereplication.py', 'pid': '133'} logrotateworker stdout | 2020-07-23 07:17:43,653 [118] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'logrotateworker.py', 'pid': '118'} builder stdout | 2020-07-23 07:17:44,555 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:17:44,954 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositoryactioncounter.py', 'pid': '114'} builder stdout | 2020-07-23 07:17:45,555 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 servicekey stdout | 2020-07-23 07:17:45,632 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'servicekeyworker.py', 'pid': '98'} gunicorn-web stdout | 2020-07-23 07:17:45,919 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '104'} gunicorn-web stdout | 2020-07-23 07:17:45,933 [435] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '435'} gunicorn-web stdout | 2020-07-23 07:17:45,970 [419] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '419'} gunicorn-web stdout | 2020-07-23 07:17:45,983 [433] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '433'} gunicorn-web stdout | 2020-07-23 07:17:45,994 [431] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '431'} gunicorn-web stdout | 2020-07-23 07:17:46,003 [438] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '438'} gunicorn-web stdout | 2020-07-23 07:17:46,008 [436] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '436'} gunicorn-web stdout | 2020-07-23 07:17:46,012 [420] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '420'} gunicorn-web stdout | 2020-07-23 07:17:46,019 [423] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '423'} builder stdout | 2020-07-23 07:17:46,540 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:17:46,540 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:17:45.555966 (running). builder stdout | 2020-07-23 07:17:46,555 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:17:47,555 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:17:48,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:17:48,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:58.291018+00:00 (in 9.999068 seconds) 2020-07-23 07:17:48,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:17:58 UTC)" (scheduled at 2020-07-23 07:17:48.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:17:48,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:17:48,304 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:17:48,304 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:17:48,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:17:58 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:17:48,383 [436] [DEBUG] [app] Starting request: urn:request:ebc76262-3c8c-4e04-bb87-6388f09c9258 (/health/instance) gunicorn-web stdout | 2020-07-23 07:17:48,386 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:17:48,391 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:17:48,393 [463] [DEBUG] [app] Starting request: urn:request:0e9c2409-fc1e-4d7e-83fb-19fe7efe1f10 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:17:48,394 [463] [DEBUG] [app] Ending request: urn:request:0e9c2409-fc1e-4d7e-83fb-19fe7efe1f10 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-registry stdout | 2020-07-23 07:17:48,395 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:17:48,395 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:17:48,396 [436] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:17:48,403 [436] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:17:48,410 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:17:48,415 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:17:48,417 [419] [DEBUG] [app] Starting request: urn:request:5bde4170-847c-41d2-a4b3-e91d08270076 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:17:48,418 [419] [DEBUG] [app] Ending request: urn:request:5bde4170-847c-41d2-a4b3-e91d08270076 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:17:48,419 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:48 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:48 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:17:48,420 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:17:48,424 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:17:48,425 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:48 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:17:48,428 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:17:48,430 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:48 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:17:48,434 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:17:48,436 [462] [DEBUG] [app] Starting request: urn:request:d871a718-9b0e-41b2-8494-10270fade755 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:17:48,438 [462] [DEBUG] [app] Ending request: urn:request:d871a718-9b0e-41b2-8494-10270fade755 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:48 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:17:48,438 [462] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:48 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:17:48,439 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:17:48,441 [436] [DEBUG] [app] Ending request: urn:request:ebc76262-3c8c-4e04-bb87-6388f09c9258 (/health/instance) gunicorn-web stdout | 2020-07-23 07:17:48,442 [436] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:17:48,443 [436] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:17:48 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:17:48 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.062 49 0.062) builder stdout | 2020-07-23 07:17:48,556 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:17:49,385 [438] [DEBUG] [app] Starting request: urn:request:61a4c1ad-983d-4410-85e7-2a29410d6c5a (/health/instance) gunicorn-web stdout | 2020-07-23 07:17:49,387 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:17:49,392 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:17:49,394 [481] [DEBUG] [app] Starting request: urn:request:ce738dbc-6be9-472a-8a88-130b5f0423f0 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:17:49,396 [481] [DEBUG] [app] Ending request: urn:request:ce738dbc-6be9-472a-8a88-130b5f0423f0 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:17:49,396 [481] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:49 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:17:49,397 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:49 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:17:49,398 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:17:49,403 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:17:49,411 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:17:49,416 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:17:49,418 [438] [DEBUG] [app] Starting request: urn:request:aa1245b3-fdde-42bd-b3b6-ba4420fa65ce (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:17:49,419 [438] [DEBUG] [app] Ending request: urn:request:aa1245b3-fdde-42bd-b3b6-ba4420fa65ce (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:49 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:17:49,420 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:49 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:17:49,421 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:17:49,424 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:49 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:17:49,425 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:17:49,428 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:17:49,429 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:49 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:17:49,434 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:17:49,436 [462] [DEBUG] [app] Starting request: urn:request:8db825e2-33f1-4d8e-ab30-3d56085d240c (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:49 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-verbs stdout | 2020-07-23 07:17:49,437 [462] [DEBUG] [app] Ending request: urn:request:8db825e2-33f1-4d8e-ab30-3d56085d240c (/c1/_internal_ping) 2020-07-23 07:17:49,438 [462] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:49 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:17:49,438 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:17:49,440 [438] [DEBUG] [app] Ending request: urn:request:61a4c1ad-983d-4410-85e7-2a29410d6c5a (/health/instance) gunicorn-web stdout | 2020-07-23 07:17:49,440 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:17:49,441 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:17:49 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:17:49 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.058 49 0.058) builder stdout | 2020-07-23 07:17:49,556 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:17:49,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:17:49,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:17:59.911177+00:00 (in 9.999019 seconds) 2020-07-23 07:17:49,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:17:59 UTC)" (scheduled at 2020-07-23 07:17:49.911177+00:00) 2020-07-23 07:17:49,912 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:17:49,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 17, 49, 912924), True, datetime.datetime(2020, 7, 23, 7, 17, 49, 912924), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:17:49,924 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:17:49,925 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:17:49,925 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:17:59 UTC)" executed successfully builder stdout | 2020-07-23 07:17:50,556 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:17:50,898 [130] [DEBUG] [buildman.server] Writing metrics builder stdout | 2020-07-23 07:17:50,915 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds builder stdout | 2020-07-23 07:17:51,556 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:17:51,559 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:17:51,565 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:17:51,565 [130] [DEBUG] [data.database] Disconnecting from database. security_notification_worker stdout | 2020-07-23 07:17:52,447 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:17:52,448 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:18:00.351857+00:00 (in 7.904070 seconds) 2020-07-23 07:17:52,448 [101] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:18:52 UTC)" (scheduled at 2020-07-23 07:17:52.446816+00:00) 2020-07-23 07:17:52,448 [101] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:17:52,448 [101] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:18:52 UTC)" executed successfully builder stdout | 2020-07-23 07:17:52,557 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-registry stdout | 2020-07-23 07:17:52,649 [469] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '469'} gunicorn-registry stdout | 2020-07-23 07:17:52,667 [100] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '100'} gunicorn-registry stdout | 2020-07-23 07:17:52,701 [463] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '463'} gunicorn-registry stdout | 2020-07-23 07:17:52,708 [477] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '477'} gunicorn-registry stdout | 2020-07-23 07:17:52,727 [478] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '478'} gunicorn-registry stdout | 2020-07-23 07:17:52,737 [470] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '470'} gunicorn-registry stdout | 2020-07-23 07:17:52,752 [476] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '476'} gunicorn-registry stdout | 2020-07-23 07:17:52,761 [480] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '480'} gunicorn-registry stdout | 2020-07-23 07:17:52,785 [467] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '467'} gunicorn-registry stdout | 2020-07-23 07:17:52,798 [475] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '475'} gunicorn-registry stdout | 2020-07-23 07:17:52,803 [479] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '479'} gunicorn-registry stdout | 2020-07-23 07:17:52,820 [474] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '474'} gunicorn-registry stdout | 2020-07-23 07:17:52,840 [472] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '472'} gunicorn-registry stdout | 2020-07-23 07:17:52,852 [465] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '465'} gunicorn-registry stdout | 2020-07-23 07:17:52,857 [473] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '473'} gunicorn-registry stdout | 2020-07-23 07:17:52,868 [471] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '471'} gunicorn-registry stdout | 2020-07-23 07:17:52,872 [481] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '481'} builder stdout | 2020-07-23 07:17:53,557 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:17:54,557 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-verbs stdout | 2020-07-23 07:17:54,909 [127] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'verbs:application', 'pid': '127'} builder stdout | 2020-07-23 07:17:55,557 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 buildlogsarchiver stdout | 2020-07-23 07:17:56,396 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:17:56,396 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:18:26.395393+00:00 (in 29.999061 seconds) 2020-07-23 07:17:56,397 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:18:26 UTC)" (scheduled at 2020-07-23 07:17:56.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:17:56,398 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 17, 56, 397320), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:17:56,408 [109] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2020-07-23 07:17:56,408 [109] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:17:56,408 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:18:26 UTC)" executed successfully builder stdout | 2020-07-23 07:17:56,541 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:17:56,542 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:17:55.558149 (running). builder stdout | 2020-07-23 07:17:56,558 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:17:57,558 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:17:58,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:17:58,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:18:08.291018+00:00 (in 9.999070 seconds) repositoryactioncounter stdout | 2020-07-23 07:17:58,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:18:08 UTC)" (scheduled at 2020-07-23 07:17:58.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:17:58,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:17:58,304 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:17:58,304 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:17:58,305 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:18:08 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:17:58,383 [438] [DEBUG] [app] Starting request: urn:request:10573d77-1964-4e02-b84f-6e2d2c2dafb0 (/health/instance) gunicorn-web stdout | 2020-07-23 07:17:58,385 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:17:58,391 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:17:58,393 [476] [DEBUG] [app] Starting request: urn:request:d35e8ab0-9b56-4772-a4ec-7fbaa22d6a93 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:17:58,394 [476] [DEBUG] [app] Ending request: urn:request:d35e8ab0-9b56-4772-a4ec-7fbaa22d6a93 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:17:58,395 [476] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:17:58,395 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:17:58,397 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:17:58,402 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:17:58,410 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:17:58,415 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:17:58,417 [438] [DEBUG] [app] Starting request: urn:request:e726488f-3c69-41d8-8422-b6ae29ec8f2d (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:17:58,418 [438] [DEBUG] [app] Ending request: urn:request:e726488f-3c69-41d8-8422-b6ae29ec8f2d (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:17:58,419 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:58 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:17:58,420 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:58 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:17:58,424 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:58 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:17:58,425 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:17:58,428 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:17:58,430 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:58 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:17:58,434 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:17:58,435 [466] [DEBUG] [app] Starting request: urn:request:0a5f9666-3847-4aa4-9461-2be2c19e6f91 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:17:58,437 [466] [DEBUG] [app] Ending request: urn:request:0a5f9666-3847-4aa4-9461-2be2c19e6f91 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:58 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:17:58,437 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:17:58,437 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:58 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:17:58,440 [438] [DEBUG] [app] Ending request: urn:request:10573d77-1964-4e02-b84f-6e2d2c2dafb0 (/health/instance) gunicorn-web stdout | 2020-07-23 07:17:58,440 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:17:58,441 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:17:58 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:17:58 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.059 49 0.059) builder stdout | 2020-07-23 07:17:58,558 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:17:59,384 [438] [DEBUG] [app] Starting request: urn:request:29e56dd4-1503-4696-b240-8c193d566be0 (/health/instance) gunicorn-web stdout | 2020-07-23 07:17:59,388 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:17:59,391 [467] [DEBUG] [app] Starting request: urn:request:4d632650-5a5b-4763-b5f8-a335d13cab36 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:17:59,392 [467] [DEBUG] [app] Ending request: urn:request:4d632650-5a5b-4763-b5f8-a335d13cab36 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:17:59,392 [467] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:59 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:17:59,393 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:59 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:17:59,394 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:17:59,401 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:17:59,409 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:17:59,415 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:17:59,417 [438] [DEBUG] [app] Starting request: urn:request:d33a1e1e-5b01-4b21-88e7-a6526e97978d (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:17:59,418 [438] [DEBUG] [app] Ending request: urn:request:d33a1e1e-5b01-4b21-88e7-a6526e97978d (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:17:59,418 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:59 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:59 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:17:59,419 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:17:59,423 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:59 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:17:59,424 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:17:59,427 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:59 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:17:59,428 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:17:59,432 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:17:59,434 [466] [DEBUG] [app] Starting request: urn:request:4fd75f4c-5e52-4eb9-9ad3-b86739f40dde (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:17:59,435 [466] [DEBUG] [app] Ending request: urn:request:4fd75f4c-5e52-4eb9-9ad3-b86739f40dde (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:17:59 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:17:59,435 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:17:59 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:17:59,437 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:17:59,440 [438] [DEBUG] [app] Ending request: urn:request:29e56dd4-1503-4696-b240-8c193d566be0 (/health/instance) gunicorn-web stdout | 2020-07-23 07:17:59,440 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:17:59,441 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:17:59 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:17:59 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.059 49 0.059) builder stdout | 2020-07-23 07:17:59,558 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:17:59,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:17:59,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:18:09.911177+00:00 (in 9.999167 seconds) 2020-07-23 07:17:59,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:18:09 UTC)" (scheduled at 2020-07-23 07:17:59.911177+00:00) 2020-07-23 07:17:59,912 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:17:59,914 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 17, 59, 912842), True, datetime.datetime(2020, 7, 23, 7, 17, 59, 912842), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:17:59,923 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:17:59,924 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:17:59,924 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:18:09 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:18:00,352 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:18:00,353 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:18:30.351857+00:00 (in 29.999075 seconds) 2020-07-23 07:18:00,353 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:18:30 UTC)" (scheduled at 2020-07-23 07:18:00.351857+00:00) 2020-07-23 07:18:00,353 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:18:00,356 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 18, 0, 353653), True, datetime.datetime(2020, 7, 23, 7, 18, 0, 353653), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:18:00,364 [101] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:18:00,364 [101] [DEBUG] [data.database] Disconnecting from database. security_notification_worker stdout | 2020-07-23 07:18:00,365 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:18:30 UTC)" executed successfully builder stdout | 2020-07-23 07:18:00,559 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:18:01,559 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:18:01,566 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:18:01,579 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:18:01,579 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:18:02,559 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 securityworker stdout | 2020-07-23 07:18:03,478 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run securityworker stdout | 2020-07-23 07:18:03,479 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:18:33 UTC)" (scheduled at 2020-07-23 07:18:03.476607+00:00) 2020-07-23 07:18:03,479 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:18:33 UTC)" executed successfully securityworker stdout | 2020-07-23 07:18:03,481 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:18:33.476607+00:00 (in 29.997984 seconds) builder stdout | 2020-07-23 07:18:03,559 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 exportactionlogsworker stdout | 2020-07-23 07:18:03,973 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:18:03,973 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:18:08.212267+00:00 (in 4.238997 seconds) 2020-07-23 07:18:03,973 [99] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:19:03 UTC)" (scheduled at 2020-07-23 07:18:03.971686+00:00) 2020-07-23 07:18:03,974 [99] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2020-07-23 07:18:03,976 [99] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 18, 3, 974316), True, datetime.datetime(2020, 7, 23, 7, 18, 3, 974316), 0, u'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2020-07-23 07:18:03,985 [99] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:18:03,985 [99] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2020-07-23 07:18:03,985 [99] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:19:03 UTC)" executed successfully builder stdout | 2020-07-23 07:18:04,559 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gcworker stdout | 2020-07-23 07:18:05,299 [110] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'gcworker.py', 'pid': '110'} builder stdout | 2020-07-23 07:18:05,560 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 expiredappspecifictokenworker stdout | 2020-07-23 07:18:05,668 [126] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '126'} securityworker stdout | 2020-07-23 07:18:06,333 [128] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'securityworker.py', 'pid': '128'} builder stdout | 2020-07-23 07:18:06,543 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:18:06,544 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:18:05.560299 (running). builder stdout | 2020-07-23 07:18:06,560 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 teamsyncworker stdout | 2020-07-23 07:18:06,663 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'teamsyncworker.py', 'pid': '115'} namespacegcworker stdout | 2020-07-23 07:18:06,910 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:18:06,911 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:18:39.024941+00:00 (in 32.113889 seconds) 2020-07-23 07:18:06,911 [134] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:19:06 UTC)" (scheduled at 2020-07-23 07:18:06.910005+00:00) 2020-07-23 07:18:06,911 [134] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2020-07-23 07:18:06,914 [134] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 18, 6, 912061), True, datetime.datetime(2020, 7, 23, 7, 18, 6, 912061), 0, u'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2020-07-23 07:18:06,926 [134] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:18:06,927 [134] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:18:06,927 [134] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:19:06 UTC)" executed successfully builder stdout | 2020-07-23 07:18:07,560 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-secscan stdout | 2020-07-23 07:18:08,056 [413] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '413'} exportactionlogsworker stdout | 2020-07-23 07:18:08,067 [99] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'exportactionlogsworker.py', 'pid': '99'} gunicorn-secscan stdout | 2020-07-23 07:18:08,071 [412] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '412'} gunicorn-secscan stdout | 2020-07-23 07:18:08,096 [122] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '122'} gunicorn-secscan stdout | 2020-07-23 07:18:08,106 [411] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '411'} gunicorn-secscan stdout | 2020-07-23 07:18:08,110 [414] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '414'} exportactionlogsworker stdout | 2020-07-23 07:18:08,213 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:18:08,214 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:03.971686+00:00 (in 55.757839 seconds) 2020-07-23 07:18:08,214 [99] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:19:08 UTC)" (scheduled at 2020-07-23 07:18:08.212267+00:00) 2020-07-23 07:18:08,214 [99] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:18:08,214 [99] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:19:08 UTC)" executed successfully repositoryactioncounter stdout | 2020-07-23 07:18:08,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:18:08,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:18:18.291018+00:00 (in 9.999102 seconds) 2020-07-23 07:18:08,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:18:18 UTC)" (scheduled at 2020-07-23 07:18:08.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:18:08,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:18:08,303 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:18:08,303 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:18:08,303 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:18:18 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:18:08,383 [436] [DEBUG] [app] Starting request: urn:request:6a2d7d81-d907-4c93-a4a9-dff5e4932b25 (/health/instance) gunicorn-web stdout | 2020-07-23 07:18:08,385 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:18:08,390 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:18:08,392 [476] [DEBUG] [app] Starting request: urn:request:daa85244-10ea-4641-84b2-3d144cd19961 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:18:08,394 [476] [DEBUG] [app] Ending request: urn:request:daa85244-10ea-4641-84b2-3d144cd19961 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:18:08,395 [476] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:08 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:18:08,395 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:08 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:18:08,396 [436] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:18:08,402 [436] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:18:08,411 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:18:08,416 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:18:08,418 [419] [DEBUG] [app] Starting request: urn:request:ab187b7e-5d9d-4c4a-a3a6-4ac475c2629f (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:18:08,419 [419] [DEBUG] [app] Ending request: urn:request:ab187b7e-5d9d-4c4a-a3a6-4ac475c2629f (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:18:08,420 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:08 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:08 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:18:08,420 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:18:08,425 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:08 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:18:08,426 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:18:08,429 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:08 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:18:08,431 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:18:08,435 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:18:08,437 [466] [DEBUG] [app] Starting request: urn:request:23568ebe-a172-41dc-98be-4683a2e0082b (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:18:08,438 [466] [DEBUG] [app] Ending request: urn:request:23568ebe-a172-41dc-98be-4683a2e0082b (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:08 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:18:08,439 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:08 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:18:08,439 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:18:08,441 [436] [DEBUG] [app] Ending request: urn:request:6a2d7d81-d907-4c93-a4a9-dff5e4932b25 (/health/instance) gunicorn-web stdout | 2020-07-23 07:18:08,442 [436] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:18:08,442 [436] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:18:08 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:18:08 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.061 49 0.061) queuecleanupworker stdout | 2020-07-23 07:18:08,589 [103] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'queuecleanupworker.py', 'pid': '103'} builder stdout | 2020-07-23 07:18:08,581 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 globalpromstats stdout | 2020-07-23 07:18:09,350 [129] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'globalpromstats.py', 'pid': '129'} gunicorn-web stdout | 2020-07-23 07:18:09,384 [431] [DEBUG] [app] Starting request: urn:request:7b4355ad-c1a3-4ff7-bffb-b69e22d4fc40 (/health/instance) gunicorn-web stdout | 2020-07-23 07:18:09,387 [431] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:18:09,392 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:18:09,394 [463] [DEBUG] [app] Starting request: urn:request:d4617bfb-5d4e-4f73-9744-4ebe42caf8e1 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:18:09,395 [463] [DEBUG] [app] Ending request: urn:request:d4617bfb-5d4e-4f73-9744-4ebe42caf8e1 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:18:09,396 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:18:09,397 [431] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-registry stdout | 2020-07-23 07:18:09,398 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:18:09,403 [431] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:18:09,410 [431] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:18:09,415 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:18:09,417 [431] [DEBUG] [app] Starting request: urn:request:865b9ec4-bbb8-4252-acbe-97668d6bfdaf (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:18:09,420 [431] [DEBUG] [app] Ending request: urn:request:865b9ec4-bbb8-4252-acbe-97668d6bfdaf (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:18:09,420 [431] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.005 159 0.005) gunicorn-web stdout | 2020-07-23 07:18:09,421 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:18:09,425 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:09 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:18:09,426 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:18:09,429 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:09 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:18:09,431 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:18:09,435 [431] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:18:09,436 [466] [DEBUG] [app] Starting request: urn:request:d66343bb-de35-4afd-a725-e980ddb5aa11 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:18:09,437 [466] [DEBUG] [app] Ending request: urn:request:d66343bb-de35-4afd-a725-e980ddb5aa11 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:18:09,438 [431] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:09 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:18:09,438 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:09 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:18:09,440 [431] [DEBUG] [app] Ending request: urn:request:7b4355ad-c1a3-4ff7-bffb-b69e22d4fc40 (/health/instance) 2020-07-23 07:18:09,441 [431] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:18:09,442 [431] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:18:09 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:18:09 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.060 49 0.060) builder stdout | 2020-07-23 07:18:09,561 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 buildlogsarchiver stdout | 2020-07-23 07:18:09,708 [109] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'buildlogsarchiver.py', 'pid': '109'} notificationworker stdout | 2020-07-23 07:18:09,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:18:09,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:18:19 UTC)" (scheduled at 2020-07-23 07:18:09.911177+00:00) 2020-07-23 07:18:09,912 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:18:09,913 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:18:11.998621+00:00 (in 2.086624 seconds) notificationworker stdout | 2020-07-23 07:18:09,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 18, 9, 912939), True, datetime.datetime(2020, 7, 23, 7, 18, 9, 912939), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:18:09,925 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:18:09,925 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:18:09,925 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:18:19 UTC)" executed successfully notificationworker stdout | 2020-07-23 07:18:09,935 [113] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'notificationworker.py', 'pid': '113'} gcworker stdout | 2020-07-23 07:18:10,005 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2020-07-23 07:18:10,006 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:18:40.004697+00:00 (in 29.998924 seconds) 2020-07-23 07:18:10,006 [110] [INFO] [apscheduler.executors.default] Running job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:18:40 UTC)" (scheduled at 2020-07-23 07:18:10.004697+00:00) gcworker stdout | 2020-07-23 07:18:10,008 [110] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1594279090006, 1209600, 500, 1, 0]) gcworker stdout | 2020-07-23 07:18:10,018 [110] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2020-07-23 07:18:10,018 [110] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:18:10,018 [110] [INFO] [apscheduler.executors.default] Job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:18:40 UTC)" executed successfully chunkcleanupworker stdout | 2020-07-23 07:18:10,152 [124] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'chunkcleanupworker.py', 'pid': '124'} builder stdout | 2020-07-23 07:18:10,561 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:18:11,443 [130] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'builder.py', 'pid': '130'} builder stdout | 2020-07-23 07:18:11,561 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:18:11,580 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:18:11,592 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:18:11,593 [130] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2020-07-23 07:18:11,643 [134] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'namespacegcworker.py', 'pid': '134'} repositorygcworker stdout | 2020-07-23 07:18:11,668 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositorygcworker.py', 'pid': '102'} notificationworker stdout | 2020-07-23 07:18:12,001 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:18:12,001 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:18:19.911177+00:00 (in 7.909800 seconds) 2020-07-23 07:18:12,002 [113] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:19:11 UTC)" (scheduled at 2020-07-23 07:18:11.998621+00:00) 2020-07-23 07:18:12,002 [113] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2020-07-23 07:18:12,002 [113] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:19:11 UTC)" executed successfully blobuploadcleanupworker stdout | 2020-07-23 07:18:12,134 [119] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'blobuploadcleanupworker.py', 'pid': '119'} builder stdout | 2020-07-23 07:18:12,561 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:18:13,562 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 security_notification_worker stdout | 2020-07-23 07:18:13,644 [101] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'security_notification_worker.py', 'pid': '101'} storagereplication stdout | 2020-07-23 07:18:13,672 [133] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'storagereplication.py', 'pid': '133'} logrotateworker stdout | 2020-07-23 07:18:13,679 [118] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'logrotateworker.py', 'pid': '118'} builder stdout | 2020-07-23 07:18:14,562 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:18:14,994 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositoryactioncounter.py', 'pid': '114'} builder stdout | 2020-07-23 07:18:15,562 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 servicekey stdout | 2020-07-23 07:18:15,672 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'servicekeyworker.py', 'pid': '98'} gunicorn-web stdout | 2020-07-23 07:18:15,931 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '104'} gunicorn-web stdout | 2020-07-23 07:18:15,945 [435] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '435'} gunicorn-web stdout | 2020-07-23 07:18:15,985 [419] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '419'} gunicorn-web stdout | 2020-07-23 07:18:15,996 [433] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '433'} gunicorn-web stdout | 2020-07-23 07:18:16,005 [431] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '431'} gunicorn-web stdout | 2020-07-23 07:18:16,017 [438] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '438'} gunicorn-web stdout | 2020-07-23 07:18:16,022 [436] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '436'} gunicorn-web stdout | 2020-07-23 07:18:16,029 [420] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '420'} gunicorn-web stdout | 2020-07-23 07:18:16,036 [423] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '423'} builder stdout | 2020-07-23 07:18:16,545 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:18:16,545 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:18:15.562536 (running). builder stdout | 2020-07-23 07:18:16,562 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:18:17,563 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:18:18,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:18:18,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:18:28.291018+00:00 (in 9.999126 seconds) 2020-07-23 07:18:18,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:18:28 UTC)" (scheduled at 2020-07-23 07:18:18.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:18:18,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:18:18,305 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:18:18,306 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:18:18,306 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:18:28 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:18:18,382 [419] [DEBUG] [app] Starting request: urn:request:7ca101ff-cf01-4995-80c6-4446104cbbcd (/health/instance) gunicorn-web stdout | 2020-07-23 07:18:18,385 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:18:18,391 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:18:18,393 [463] [DEBUG] [app] Starting request: urn:request:2e714217-58c6-4f09-a38b-3c4cfdc9e5ef (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:18:18,394 [463] [DEBUG] [app] Ending request: urn:request:2e714217-58c6-4f09-a38b-3c4cfdc9e5ef (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:18 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-registry stdout | 2020-07-23 07:18:18,395 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:18 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:18:18,395 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:18:18,397 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:18:18,403 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:18:18,411 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:18:18,417 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:18:18,418 [438] [DEBUG] [app] Starting request: urn:request:1451fade-2c62-4665-ba21-95844c61c216 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:18:18,419 [438] [DEBUG] [app] Ending request: urn:request:1451fade-2c62-4665-ba21-95844c61c216 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:18 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:18:18,420 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:18 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:18:18,420 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:18:18,425 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:18 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:18:18,425 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:18:18,429 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:18 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:18:18,431 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:18:18,436 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:18:18,438 [466] [DEBUG] [app] Starting request: urn:request:75498dcd-402f-4449-90dd-6398c63504f8 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:18:18,439 [466] [DEBUG] [app] Ending request: urn:request:75498dcd-402f-4449-90dd-6398c63504f8 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:18 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-verbs stdout | 2020-07-23 07:18:18,440 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:18 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:18:18,440 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:18:18,443 [419] [DEBUG] [app] Ending request: urn:request:7ca101ff-cf01-4995-80c6-4446104cbbcd (/health/instance) gunicorn-web stdout | 2020-07-23 07:18:18,443 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:18:18,444 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:18:18 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:18:18 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.063 49 0.063) builder stdout | 2020-07-23 07:18:18,563 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:18:19,384 [433] [DEBUG] [app] Starting request: urn:request:1c454d42-e79f-4087-b324-20697be15355 (/health/instance) gunicorn-web stdout | 2020-07-23 07:18:19,386 [433] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:18:19,392 [433] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:18:19,394 [481] [DEBUG] [app] Starting request: urn:request:caf11204-ed0b-4119-970e-527d293b099f (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:18:19,395 [481] [DEBUG] [app] Ending request: urn:request:caf11204-ed0b-4119-970e-527d293b099f (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:18:19,396 [481] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:19 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:18:19,397 [433] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:19 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:18:19,398 [433] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:18:19,404 [433] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:18:19,413 [433] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:18:19,418 [433] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:18:19,420 [433] [DEBUG] [app] Starting request: urn:request:0b7d133a-e6d6-4d3b-910c-f72525b94bf5 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:18:19,421 [433] [DEBUG] [app] Ending request: urn:request:0b7d133a-e6d6-4d3b-910c-f72525b94bf5 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:18:19,422 [433] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:19 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:19 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:18:19,422 [433] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:18:19,427 [433] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:19 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:18:19,428 [433] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:18:19,431 [433] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:19 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.002 153 0.002) gunicorn-web stdout | 2020-07-23 07:18:19,433 [433] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:18:19,438 [433] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:18:19,440 [468] [DEBUG] [app] Starting request: urn:request:e97e40d5-8c63-4d32-b453-818b0209d23f (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:18:19,441 [468] [DEBUG] [app] Ending request: urn:request:e97e40d5-8c63-4d32-b453-818b0209d23f (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:18:19,442 [433] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:19 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:18:19,442 [468] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:19 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:18:19,443 [433] [DEBUG] [app] Ending request: urn:request:1c454d42-e79f-4087-b324-20697be15355 (/health/instance) 2020-07-23 07:18:19,444 [433] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:18:19,444 [433] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:18:19 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:18:19 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.061 49 0.061) builder stdout | 2020-07-23 07:18:19,563 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:18:19,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:18:19,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:18:29.911177+00:00 (in 9.998994 seconds) 2020-07-23 07:18:19,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:18:29 UTC)" (scheduled at 2020-07-23 07:18:19.911177+00:00) 2020-07-23 07:18:19,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:18:19,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 18, 19, 913224), True, datetime.datetime(2020, 7, 23, 7, 18, 19, 913224), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:18:19,924 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:18:19,924 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:18:19,924 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:18:29 UTC)" executed successfully builder stdout | 2020-07-23 07:18:20,563 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:18:20,916 [130] [DEBUG] [buildman.server] Writing metrics builder stdout | 2020-07-23 07:18:20,935 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds builder stdout | 2020-07-23 07:18:21,563 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:18:21,594 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:18:21,601 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:18:21,601 [130] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:18:21,739 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:18:21,740 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:18:28.907644+00:00 (in 7.167590 seconds) 2020-07-23 07:18:21,740 [102] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:19:21 UTC)" (scheduled at 2020-07-23 07:18:21.739118+00:00) 2020-07-23 07:18:21,740 [102] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2020-07-23 07:18:21,743 [102] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 18, 21, 740929), True, datetime.datetime(2020, 7, 23, 7, 18, 21, 740929), 0, u'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2020-07-23 07:18:21,751 [102] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:18:21,752 [102] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:18:21,752 [102] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:19:21 UTC)" executed successfully builder stdout | 2020-07-23 07:18:22,564 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-registry stdout | 2020-07-23 07:18:22,660 [469] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '469'} gunicorn-registry stdout | 2020-07-23 07:18:22,681 [100] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '100'} gunicorn-registry stdout | 2020-07-23 07:18:22,714 [463] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '463'} gunicorn-registry stdout | 2020-07-23 07:18:22,721 [477] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '477'} gunicorn-registry stdout | 2020-07-23 07:18:22,740 [478] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '478'} gunicorn-registry stdout | 2020-07-23 07:18:22,756 [470] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '470'} gunicorn-registry stdout | 2020-07-23 07:18:22,766 [476] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '476'} gunicorn-registry stdout | 2020-07-23 07:18:22,777 [480] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '480'} gunicorn-registry stdout | 2020-07-23 07:18:22,801 [467] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '467'} gunicorn-registry stdout | 2020-07-23 07:18:22,813 [475] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '475'} gunicorn-registry stdout | 2020-07-23 07:18:22,819 [479] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '479'} gunicorn-registry stdout | 2020-07-23 07:18:22,830 [474] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '474'} gunicorn-registry stdout | 2020-07-23 07:18:22,851 [472] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '472'} gunicorn-registry stdout | 2020-07-23 07:18:22,866 [465] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '465'} gunicorn-registry stdout | 2020-07-23 07:18:22,871 [473] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '473'} gunicorn-registry stdout | 2020-07-23 07:18:22,881 [471] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '471'} gunicorn-registry stdout | 2020-07-23 07:18:22,886 [481] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '481'} builder stdout | 2020-07-23 07:18:23,564 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:18:24,564 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-verbs stdout | 2020-07-23 07:18:25,018 [127] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'verbs:application', 'pid': '127'} builder stdout | 2020-07-23 07:18:25,564 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 buildlogsarchiver stdout | 2020-07-23 07:18:26,396 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:18:26,396 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:18:56.395393+00:00 (in 29.999069 seconds) 2020-07-23 07:18:26,397 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:18:56 UTC)" (scheduled at 2020-07-23 07:18:26.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:18:26,399 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 18, 26, 397220), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:18:26,408 [109] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2020-07-23 07:18:26,408 [109] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:18:26,408 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:18:56 UTC)" executed successfully builder stdout | 2020-07-23 07:18:26,546 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 2020-07-23 07:18:26,547 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:18:25.565159 (running). builder stdout | 2020-07-23 07:18:26,584 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:18:27,565 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:18:28,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:18:28,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:18:38.291018+00:00 (in 9.999019 seconds) repositoryactioncounter stdout | 2020-07-23 07:18:28,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:18:38 UTC)" (scheduled at 2020-07-23 07:18:28.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:18:28,303 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:18:28,312 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:18:28,313 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:18:28,313 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:18:38 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:18:28,382 [419] [DEBUG] [app] Starting request: urn:request:49f3d60b-b381-4d97-9eb5-c6a7f0c15575 (/health/instance) gunicorn-web stdout | 2020-07-23 07:18:28,385 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:18:28,391 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:18:28,393 [475] [DEBUG] [app] Starting request: urn:request:136bb6ed-30be-4dc6-97b0-08273a7d3dfb (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:18:28,395 [475] [DEBUG] [app] Ending request: urn:request:136bb6ed-30be-4dc6-97b0-08273a7d3dfb (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:28 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-registry stdout | 2020-07-23 07:18:28,396 [475] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:28 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:18:28,396 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:18:28,398 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:18:28,404 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:18:28,412 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:18:28,417 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:18:28,420 [419] [DEBUG] [app] Starting request: urn:request:384998dd-a78f-4f73-8959-d117f68ffba3 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:18:28,421 [419] [DEBUG] [app] Ending request: urn:request:384998dd-a78f-4f73-8959-d117f68ffba3 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:28 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:18:28,421 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:28 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:18:28,422 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:18:28,425 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:28 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:18:28,426 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:18:28,430 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:28 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:18:28,431 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:18:28,435 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:18:28,437 [466] [DEBUG] [app] Starting request: urn:request:f2e8ec45-fc7c-4b85-8732-8d70c4e40d30 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:18:28,439 [466] [DEBUG] [app] Ending request: urn:request:f2e8ec45-fc7c-4b85-8732-8d70c4e40d30 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:28 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:18:28,439 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:28 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:18:28,439 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:18:28,442 [419] [DEBUG] [app] Ending request: urn:request:49f3d60b-b381-4d97-9eb5-c6a7f0c15575 (/health/instance) 2020-07-23 07:18:28,442 [419] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:18:28 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.062 49 0.062) gunicorn-web stdout | 2020-07-23 07:18:28,443 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:18:28 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" builder stdout | 2020-07-23 07:18:28,565 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositorygcworker stdout | 2020-07-23 07:18:28,908 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:18:28,909 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:21.739118+00:00 (in 52.830419 seconds) 2020-07-23 07:18:28,909 [102] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:19:28 UTC)" (scheduled at 2020-07-23 07:18:28.907644+00:00) 2020-07-23 07:18:28,909 [102] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:18:28,909 [102] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:19:28 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:18:29,384 [419] [DEBUG] [app] Starting request: urn:request:e9738b81-befc-4e30-80b0-a2af280647f9 (/health/instance) gunicorn-web stdout | 2020-07-23 07:18:29,388 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:18:29,391 [475] [DEBUG] [app] Starting request: urn:request:4ba102a3-f3e5-4952-a14c-7e2aede8bb07 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:18:29,392 [475] [DEBUG] [app] Ending request: urn:request:4ba102a3-f3e5-4952-a14c-7e2aede8bb07 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:29 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-registry stdout | 2020-07-23 07:18:29,393 [475] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:29 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:18:29,394 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:18:29,395 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:18:29,402 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:18:29,411 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:18:29,417 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:18:29,419 [419] [DEBUG] [app] Starting request: urn:request:9a797e2a-6f42-434e-854c-113a4fd28c3d (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:18:29,420 [419] [DEBUG] [app] Ending request: urn:request:9a797e2a-6f42-434e-854c-113a4fd28c3d (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:18:29,421 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:29 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:29 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:18:29,421 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:18:29,426 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:29 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:18:29,426 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:18:29,430 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:29 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:18:29,432 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:18:29,436 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:18:29,438 [466] [DEBUG] [app] Starting request: urn:request:ddeed445-2bf4-431c-957d-2493471fe56e (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:18:29,440 [466] [DEBUG] [app] Ending request: urn:request:ddeed445-2bf4-431c-957d-2493471fe56e (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:29 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:18:29,440 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:29 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:18:29,440 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:18:29,442 [419] [DEBUG] [app] Ending request: urn:request:e9738b81-befc-4e30-80b0-a2af280647f9 (/health/instance) gunicorn-web stdout | 2020-07-23 07:18:29,443 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:18:29,443 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:18:29 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:18:29 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.060 49 0.060) builder stdout | 2020-07-23 07:18:29,566 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:18:29,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:18:29,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:18:39.911177+00:00 (in 9.999028 seconds) 2020-07-23 07:18:29,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:18:39 UTC)" (scheduled at 2020-07-23 07:18:29.911177+00:00) notificationworker stdout | 2020-07-23 07:18:29,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:18:29,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 18, 29, 913493), True, datetime.datetime(2020, 7, 23, 7, 18, 29, 913493), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:18:29,925 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:18:29,925 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:18:29,925 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:18:39 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:18:30,352 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:18:30,353 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:18:52.446816+00:00 (in 22.093772 seconds) 2020-07-23 07:18:30,353 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:19:00 UTC)" (scheduled at 2020-07-23 07:18:30.351857+00:00) 2020-07-23 07:18:30,354 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:18:30,356 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 18, 30, 354113), True, datetime.datetime(2020, 7, 23, 7, 18, 30, 354113), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:18:30,366 [101] [DEBUG] [workers.queueworker] No more work. security_notification_worker stdout | 2020-07-23 07:18:30,366 [101] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:18:30,366 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:19:00 UTC)" executed successfully builder stdout | 2020-07-23 07:18:30,566 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:18:31,566 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:18:31,602 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:18:31,614 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:18:31,614 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:18:32,566 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 securityworker stdout | 2020-07-23 07:18:33,479 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run securityworker stdout | 2020-07-23 07:18:33,480 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:03.476607+00:00 (in 29.996492 seconds) 2020-07-23 07:18:33,480 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:19:03 UTC)" (scheduled at 2020-07-23 07:18:33.476607+00:00) securityworker stdout | 2020-07-23 07:18:33,481 [128] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "image" AS "t1" WHERE ("t1"."security_indexed_engine" < %s)', [3]) securityworker stdout | 2020-07-23 07:18:33,489 [128] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "image" AS "t1"', []) securityworker stdout | 2020-07-23 07:18:33,490 [128] [DEBUG] [data.secscan_model.secscan_v2_model] Found no additional images to scan securityworker stdout | 2020-07-23 07:18:33,491 [128] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:18:33,491 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:19:03 UTC)" executed successfully builder stdout | 2020-07-23 07:18:33,566 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:18:34,567 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gcworker stdout | 2020-07-23 07:18:35,338 [110] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'gcworker.py', 'pid': '110'} builder stdout | 2020-07-23 07:18:35,567 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 expiredappspecifictokenworker stdout | 2020-07-23 07:18:35,707 [126] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '126'} securityworker stdout | 2020-07-23 07:18:36,370 [128] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'securityworker.py', 'pid': '128'} builder stdout | 2020-07-23 07:18:36,548 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:18:36,548 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:18:35.567380 (running). builder stdout | 2020-07-23 07:18:36,567 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 teamsyncworker stdout | 2020-07-23 07:18:36,704 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'teamsyncworker.py', 'pid': '115'} builder stdout | 2020-07-23 07:18:37,567 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-secscan stdout | 2020-07-23 07:18:38,067 [413] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '413'} gunicorn-secscan stdout | 2020-07-23 07:18:38,083 [412] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '412'} exportactionlogsworker stdout | 2020-07-23 07:18:38,103 [99] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'exportactionlogsworker.py', 'pid': '99'} gunicorn-secscan stdout | 2020-07-23 07:18:38,107 [122] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '122'} gunicorn-secscan stdout | 2020-07-23 07:18:38,118 [411] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '411'} gunicorn-secscan stdout | 2020-07-23 07:18:38,123 [414] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '414'} repositoryactioncounter stdout | 2020-07-23 07:18:38,292 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:18:38,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:18:48.291018+00:00 (in 9.998609 seconds) 2020-07-23 07:18:38,293 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:18:48 UTC)" (scheduled at 2020-07-23 07:18:38.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:18:38,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:18:38,302 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:18:38,303 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:18:38,303 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:18:48 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:18:38,383 [419] [DEBUG] [app] Starting request: urn:request:9bcb17fc-4958-4180-91d8-ec8db8f7bbca (/health/instance) gunicorn-web stdout | 2020-07-23 07:18:38,386 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:18:38,391 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:18:38,394 [463] [DEBUG] [app] Starting request: urn:request:9f839763-550d-4017-806c-f80aed4df846 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:18:38,395 [463] [DEBUG] [app] Ending request: urn:request:9f839763-550d-4017-806c-f80aed4df846 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:18:38,396 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:38 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:38 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.005 162 0.005) gunicorn-web stdout | 2020-07-23 07:18:38,398 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:18:38,400 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:18:38,407 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:18:38,416 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:18:38,422 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:18:38,424 [419] [DEBUG] [app] Starting request: urn:request:eb91f031-a93c-4cb5-a401-1ef2c9723592 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:18:38,425 [419] [DEBUG] [app] Ending request: urn:request:eb91f031-a93c-4cb5-a401-1ef2c9723592 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:38 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:18:38,426 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:38 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:18:38,427 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:18:38,431 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:38 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:18:38,432 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:18:38,435 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:38 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:18:38,436 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:18:38,440 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:18:38,443 [468] [DEBUG] [app] Starting request: urn:request:0729c2a3-db7c-44ba-8827-bce60039ac28 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:18:38,444 [468] [DEBUG] [app] Ending request: urn:request:0729c2a3-db7c-44ba-8827-bce60039ac28 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:38 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-verbs stdout | 2020-07-23 07:18:38,445 [468] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:38 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:18:38,445 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:18:38,447 [419] [DEBUG] [app] Ending request: urn:request:9bcb17fc-4958-4180-91d8-ec8db8f7bbca (/health/instance) 2020-07-23 07:18:38,447 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:18:38,448 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:18:38 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:18:38 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.066 49 0.066) builder stdout | 2020-07-23 07:18:38,567 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 queuecleanupworker stdout | 2020-07-23 07:18:38,629 [103] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'queuecleanupworker.py', 'pid': '103'} namespacegcworker stdout | 2020-07-23 07:18:39,025 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:18:39,026 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:06.910005+00:00 (in 27.884126 seconds) 2020-07-23 07:18:39,026 [134] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:19:39 UTC)" (scheduled at 2020-07-23 07:18:39.024941+00:00) 2020-07-23 07:18:39,026 [134] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:18:39,026 [134] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:19:39 UTC)" executed successfully globalpromstats stdout | 2020-07-23 07:18:39,384 [129] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'globalpromstats.py', 'pid': '129'} gunicorn-web stdout | 2020-07-23 07:18:39,385 [419] [DEBUG] [app] Starting request: urn:request:c70753e2-66a5-4440-b0a4-207fc1d97874 (/health/instance) gunicorn-web stdout | 2020-07-23 07:18:39,389 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:18:39,391 [480] [DEBUG] [app] Starting request: urn:request:bd065fbd-cca3-46f0-8be2-868289afa390 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:18:39,393 [480] [DEBUG] [app] Ending request: urn:request:bd065fbd-cca3-46f0-8be2-868289afa390 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:18:39,394 [480] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:18:39,394 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:18:39,395 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:18:39,403 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:18:39,411 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:18:39,417 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:18:39,418 [419] [DEBUG] [app] Starting request: urn:request:516de815-8c10-4ecd-9586-22ddc7d4983d (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:18:39,420 [419] [DEBUG] [app] Ending request: urn:request:516de815-8c10-4ecd-9586-22ddc7d4983d (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:18:39,420 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:18:39,421 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:18:39,425 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:39 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:18:39,426 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:18:39,430 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:39 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:18:39,431 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:18:39,435 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:18:39,437 [466] [DEBUG] [app] Starting request: urn:request:63fed959-7d8e-4614-bd73-acd1c61b5374 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:39 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:18:39,438 [466] [DEBUG] [app] Ending request: urn:request:63fed959-7d8e-4614-bd73-acd1c61b5374 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:18:39,439 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:18:39,439 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:39 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:18:39,441 [419] [DEBUG] [app] Ending request: urn:request:c70753e2-66a5-4440-b0a4-207fc1d97874 (/health/instance) 2020-07-23 07:18:39,441 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:18:39,442 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:18:39 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:18:39 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.059 49 0.059) builder stdout | 2020-07-23 07:18:39,568 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 buildlogsarchiver stdout | 2020-07-23 07:18:39,746 [109] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'buildlogsarchiver.py', 'pid': '109'} notificationworker stdout | 2020-07-23 07:18:39,913 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:18:39,914 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:18:49.911177+00:00 (in 9.997144 seconds) 2020-07-23 07:18:39,914 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:18:49 UTC)" (scheduled at 2020-07-23 07:18:39.911177+00:00) 2020-07-23 07:18:39,914 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:18:39,917 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 18, 39, 915023), True, datetime.datetime(2020, 7, 23, 7, 18, 39, 915023), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:18:39,927 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:18:39,927 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:18:39,927 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:18:49 UTC)" executed successfully notificationworker stdout | 2020-07-23 07:18:39,975 [113] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'notificationworker.py', 'pid': '113'} gcworker stdout | 2020-07-23 07:18:40,006 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2020-07-23 07:18:40,007 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:10.004697+00:00 (in 29.997444 seconds) 2020-07-23 07:18:40,008 [110] [INFO] [apscheduler.executors.default] Running job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:19:10 UTC)" (scheduled at 2020-07-23 07:18:40.004697+00:00) gcworker stdout | 2020-07-23 07:18:40,010 [110] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1594279120008, 1209600, 500, 1, 0]) gcworker stdout | 2020-07-23 07:18:40,020 [110] [DEBUG] [__main__] No repository with garbage found 2020-07-23 07:18:40,020 [110] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2020-07-23 07:18:40,020 [110] [INFO] [apscheduler.executors.default] Job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:19:10 UTC)" executed successfully chunkcleanupworker stdout | 2020-07-23 07:18:40,193 [124] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'chunkcleanupworker.py', 'pid': '124'} builder stdout | 2020-07-23 07:18:40,568 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:18:41,483 [130] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'builder.py', 'pid': '130'} builder stdout | 2020-07-23 07:18:41,568 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:18:41,616 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:18:41,628 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:18:41,629 [130] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2020-07-23 07:18:41,671 [134] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'namespacegcworker.py', 'pid': '134'} repositorygcworker stdout | 2020-07-23 07:18:41,707 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositorygcworker.py', 'pid': '102'} blobuploadcleanupworker stdout | 2020-07-23 07:18:42,174 [119] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'blobuploadcleanupworker.py', 'pid': '119'} builder stdout | 2020-07-23 07:18:42,568 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:18:43,569 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 security_notification_worker stdout | 2020-07-23 07:18:43,683 [101] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'security_notification_worker.py', 'pid': '101'} storagereplication stdout | 2020-07-23 07:18:43,711 [133] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'storagereplication.py', 'pid': '133'} logrotateworker stdout | 2020-07-23 07:18:43,715 [118] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'logrotateworker.py', 'pid': '118'} builder stdout | 2020-07-23 07:18:44,569 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:18:45,031 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositoryactioncounter.py', 'pid': '114'} builder stdout | 2020-07-23 07:18:45,569 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 servicekey stdout | 2020-07-23 07:18:45,710 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'servicekeyworker.py', 'pid': '98'} gunicorn-web stdout | 2020-07-23 07:18:45,941 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '104'} gunicorn-web stdout | 2020-07-23 07:18:45,956 [435] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '435'} gunicorn-web stdout | 2020-07-23 07:18:45,999 [419] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '419'} gunicorn-web stdout | 2020-07-23 07:18:46,009 [433] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '433'} gunicorn-web stdout | 2020-07-23 07:18:46,017 [431] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '431'} gunicorn-web stdout | 2020-07-23 07:18:46,038 [438] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '438'} gunicorn-web stdout | 2020-07-23 07:18:46,044 [436] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '436'} gunicorn-web stdout | 2020-07-23 07:18:46,048 [420] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '420'} gunicorn-web stdout | 2020-07-23 07:18:46,054 [423] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '423'} builder stdout | 2020-07-23 07:18:46,550 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:18:46,551 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:18:45.569719 (running). builder stdout | 2020-07-23 07:18:46,569 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:18:47,569 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:18:48,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:18:48,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:18:58.291018+00:00 (in 9.999035 seconds) repositoryactioncounter stdout | 2020-07-23 07:18:48,294 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:18:58 UTC)" (scheduled at 2020-07-23 07:18:48.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:18:48,296 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:18:48,305 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:18:48,305 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:18:48,305 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:18:58 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:18:48,382 [438] [DEBUG] [app] Starting request: urn:request:ceefc517-1b8f-4d94-bdd5-eca5c205917a (/health/instance) gunicorn-web stdout | 2020-07-23 07:18:48,385 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:18:48,390 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:18:48,392 [463] [DEBUG] [app] Starting request: urn:request:6575250d-7bb1-4523-9f53-66bc6085dfc8 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:18:48,393 [463] [DEBUG] [app] Ending request: urn:request:6575250d-7bb1-4523-9f53-66bc6085dfc8 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:18:48,394 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:18:48,394 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:18:48,395 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:18:48,401 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:18:48,408 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:18:48,413 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:18:48,415 [419] [DEBUG] [app] Starting request: urn:request:5486ec91-9ecd-4243-84d8-0fc30bbbe750 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:18:48,416 [419] [DEBUG] [app] Ending request: urn:request:5486ec91-9ecd-4243-84d8-0fc30bbbe750 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:18:48,417 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:48 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:18:48,417 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:48 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:18:48,421 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) 2020-07-23 07:18:48,422 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:48 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:18:48,425 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:48 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:18:48,427 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:18:48,432 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:18:48,433 [468] [DEBUG] [app] Starting request: urn:request:842aa762-139b-4a38-a8d8-36839a10ccc5 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:18:48,435 [468] [DEBUG] [app] Ending request: urn:request:842aa762-139b-4a38-a8d8-36839a10ccc5 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:48 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:18:48,436 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:18:48,435 [468] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:48 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:18:48,438 [438] [DEBUG] [app] Ending request: urn:request:ceefc517-1b8f-4d94-bdd5-eca5c205917a (/health/instance) 2020-07-23 07:18:48,438 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:18:48,439 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:18:48 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:18:48 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.059 49 0.059) builder stdout | 2020-07-23 07:18:48,570 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:18:49,384 [419] [DEBUG] [app] Starting request: urn:request:ada55afe-1bf4-41f3-81dd-bda2b98ecf61 (/health/instance) gunicorn-web stdout | 2020-07-23 07:18:49,387 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:18:49,393 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:18:49,395 [480] [DEBUG] [app] Starting request: urn:request:14cebc74-3554-47e7-8526-2057d4686565 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:18:49,397 [480] [DEBUG] [app] Ending request: urn:request:14cebc74-3554-47e7-8526-2057d4686565 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:49 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-registry stdout | 2020-07-23 07:18:49,398 [480] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:49 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:18:49,398 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:18:49,399 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:18:49,405 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:18:49,413 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:18:49,418 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:18:49,420 [419] [DEBUG] [app] Starting request: urn:request:3a43e286-f548-4895-910a-219c499d2a82 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:18:49,421 [419] [DEBUG] [app] Ending request: urn:request:3a43e286-f548-4895-910a-219c499d2a82 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:18:49,422 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:49 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:18:49,422 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:49 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:18:49,426 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:49 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:18:49,427 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:18:49,431 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:18:49,432 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:49 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:18:49,437 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:18:49,439 [466] [DEBUG] [app] Starting request: urn:request:9c1a9f7d-db95-4eb8-a137-b1e0f2aa85f6 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:49 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:18:49,439 [466] [DEBUG] [app] Ending request: urn:request:9c1a9f7d-db95-4eb8-a137-b1e0f2aa85f6 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:18:49,440 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:18:49,440 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:49 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:18:49,443 [419] [DEBUG] [app] Ending request: urn:request:ada55afe-1bf4-41f3-81dd-bda2b98ecf61 (/health/instance) 2020-07-23 07:18:49,443 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:18:49,444 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:18:49 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:18:49 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.062 49 0.062) builder stdout | 2020-07-23 07:18:49,570 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:18:49,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:18:49,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:18:59.911177+00:00 (in 9.999039 seconds) 2020-07-23 07:18:49,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:18:59 UTC)" (scheduled at 2020-07-23 07:18:49.911177+00:00) 2020-07-23 07:18:49,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:18:49,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 18, 49, 913106), True, datetime.datetime(2020, 7, 23, 7, 18, 49, 913106), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:18:49,926 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:18:49,926 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:18:49,926 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:18:59 UTC)" executed successfully builder stdout | 2020-07-23 07:18:50,570 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:18:50,936 [130] [DEBUG] [buildman.server] Writing metrics builder stdout | 2020-07-23 07:18:50,951 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds builder stdout | 2020-07-23 07:18:51,570 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:18:51,630 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:18:51,636 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:18:51,636 [130] [DEBUG] [data.database] Disconnecting from database. security_notification_worker stdout | 2020-07-23 07:18:52,447 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:18:52,448 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:00.351857+00:00 (in 7.903920 seconds) 2020-07-23 07:18:52,448 [101] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:19:52 UTC)" (scheduled at 2020-07-23 07:18:52.446816+00:00) 2020-07-23 07:18:52,448 [101] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:18:52,448 [101] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:19:52 UTC)" executed successfully builder stdout | 2020-07-23 07:18:52,571 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-registry stdout | 2020-07-23 07:18:52,672 [469] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '469'} gunicorn-registry stdout | 2020-07-23 07:18:52,695 [100] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '100'} gunicorn-registry stdout | 2020-07-23 07:18:52,731 [463] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '463'} gunicorn-registry stdout | 2020-07-23 07:18:52,739 [477] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '477'} gunicorn-registry stdout | 2020-07-23 07:18:52,752 [478] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '478'} gunicorn-registry stdout | 2020-07-23 07:18:52,771 [470] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '470'} gunicorn-registry stdout | 2020-07-23 07:18:52,780 [476] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '476'} gunicorn-registry stdout | 2020-07-23 07:18:52,788 [480] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '480'} gunicorn-registry stdout | 2020-07-23 07:18:52,816 [467] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '467'} gunicorn-registry stdout | 2020-07-23 07:18:52,827 [475] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '475'} gunicorn-registry stdout | 2020-07-23 07:18:52,831 [479] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '479'} gunicorn-registry stdout | 2020-07-23 07:18:52,841 [474] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '474'} gunicorn-registry stdout | 2020-07-23 07:18:52,862 [472] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '472'} gunicorn-registry stdout | 2020-07-23 07:18:52,882 [465] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '465'} gunicorn-registry stdout | 2020-07-23 07:18:52,887 [473] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '473'} gunicorn-registry stdout | 2020-07-23 07:18:52,895 [471] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '471'} gunicorn-registry stdout | 2020-07-23 07:18:52,899 [481] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '481'} builder stdout | 2020-07-23 07:18:53,571 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:18:54,571 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-verbs stdout | 2020-07-23 07:18:55,129 [127] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'verbs:application', 'pid': '127'} builder stdout | 2020-07-23 07:18:55,571 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 buildlogsarchiver stdout | 2020-07-23 07:18:56,396 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:18:56,396 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:26.395393+00:00 (in 29.999044 seconds) 2020-07-23 07:18:56,397 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:19:26 UTC)" (scheduled at 2020-07-23 07:18:56.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:18:56,398 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 18, 56, 397257), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:18:56,408 [109] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2020-07-23 07:18:56,408 [109] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:18:56,408 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:19:26 UTC)" executed successfully builder stdout | 2020-07-23 07:18:56,552 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:18:56,553 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:18:55.572037 (running). builder stdout | 2020-07-23 07:18:56,571 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:18:57,572 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:18:58,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:18:58,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:08.291018+00:00 (in 9.999100 seconds) repositoryactioncounter stdout | 2020-07-23 07:18:58,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:19:08 UTC)" (scheduled at 2020-07-23 07:18:58.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:18:58,297 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:18:58,306 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:18:58,307 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:18:58,307 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:19:08 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:18:58,383 [423] [DEBUG] [app] Starting request: urn:request:976e342c-b82b-4fca-b07a-b8841e1d28de (/health/instance) gunicorn-web stdout | 2020-07-23 07:18:58,388 [423] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:18:58,394 [423] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:18:58,396 [473] [DEBUG] [app] Starting request: urn:request:092fbd24-c706-452a-82dc-a23f670de6a0 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:18:58,397 [473] [DEBUG] [app] Ending request: urn:request:092fbd24-c706-452a-82dc-a23f670de6a0 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:18:58,398 [473] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:18:58,398 [423] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:18:58,399 [423] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:18:58,406 [423] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:18:58,414 [423] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:18:58,419 [423] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:18:58,421 [423] [DEBUG] [app] Starting request: urn:request:72613fb4-d2e2-405a-8b7f-731cf56295df (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:18:58,422 [423] [DEBUG] [app] Ending request: urn:request:72613fb4-d2e2-405a-8b7f-731cf56295df (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:18:58,423 [423] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:58 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:58 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:18:58,424 [423] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:18:58,428 [423] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:58 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:18:58,429 [423] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:18:58,435 [423] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:58 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:18:58,436 [423] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:18:58,441 [423] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:18:58,442 [468] [DEBUG] [app] Starting request: urn:request:86d6a677-4f05-46c2-821f-c7905a8a3583 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:18:58,444 [468] [DEBUG] [app] Ending request: urn:request:86d6a677-4f05-46c2-821f-c7905a8a3583 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:58 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:18:58,444 [468] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:58 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:18:58,445 [423] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:18:58,447 [423] [DEBUG] [app] Ending request: urn:request:976e342c-b82b-4fca-b07a-b8841e1d28de (/health/instance) gunicorn-web stdout | 2020-07-23 07:18:58,447 [423] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:18:58,448 [423] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:18:58 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:18:58 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.066 49 0.066) builder stdout | 2020-07-23 07:18:58,572 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:18:59,384 [436] [DEBUG] [app] Starting request: urn:request:3b4b9eae-cd1b-41ae-a714-c22893347274 (/health/instance) gunicorn-web stdout | 2020-07-23 07:18:59,387 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:18:59,393 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:18:59,395 [465] [DEBUG] [app] Starting request: urn:request:36a30397-3478-4460-8410-5ae876f1a78e (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:18:59,396 [465] [DEBUG] [app] Ending request: urn:request:36a30397-3478-4460-8410-5ae876f1a78e (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:18:59,397 [465] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:59 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:59 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:18:59,397 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:18:59,398 [436] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:18:59,404 [436] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:18:59,414 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:18:59,420 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:18:59,422 [436] [DEBUG] [app] Starting request: urn:request:13ce6b4c-7893-4511-b74a-fa1adaa8e81e (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:18:59,423 [436] [DEBUG] [app] Ending request: urn:request:13ce6b4c-7893-4511-b74a-fa1adaa8e81e (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:59 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:18:59,424 [436] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:59 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:18:59,424 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:18:59,428 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:59 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:18:59,429 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:18:59,432 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:59 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:18:59,433 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:18:59,437 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:18:59,439 [468] [DEBUG] [app] Starting request: urn:request:462a6c6a-9a1c-4817-a9f1-7070ee8178fd (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:18:59,440 [468] [DEBUG] [app] Ending request: urn:request:462a6c6a-9a1c-4817-a9f1-7070ee8178fd (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:18:59 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-verbs stdout | 2020-07-23 07:18:59,441 [468] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:18:59 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:18:59,441 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:18:59,443 [436] [DEBUG] [app] Ending request: urn:request:3b4b9eae-cd1b-41ae-a714-c22893347274 (/health/instance) 2020-07-23 07:18:59,443 [436] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:18:59 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.062 49 0.062) gunicorn-web stdout | 2020-07-23 07:18:59,444 [436] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:18:59 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" builder stdout | 2020-07-23 07:18:59,572 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:18:59,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:18:59,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:09.911177+00:00 (in 9.999006 seconds) 2020-07-23 07:18:59,913 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:19:09 UTC)" (scheduled at 2020-07-23 07:18:59.911177+00:00) 2020-07-23 07:18:59,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:18:59,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 18, 59, 913412), True, datetime.datetime(2020, 7, 23, 7, 18, 59, 913412), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:18:59,923 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:18:59,924 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:18:59,924 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:19:09 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:19:00,352 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:19:00,353 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:30.351857+00:00 (in 29.999022 seconds) 2020-07-23 07:19:00,353 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:19:30 UTC)" (scheduled at 2020-07-23 07:19:00.351857+00:00) 2020-07-23 07:19:00,353 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:19:00,355 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 19, 0, 353834), True, datetime.datetime(2020, 7, 23, 7, 19, 0, 353834), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:19:00,364 [101] [DEBUG] [workers.queueworker] No more work. security_notification_worker stdout | 2020-07-23 07:19:00,364 [101] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:19:00,364 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:19:30 UTC)" executed successfully builder stdout | 2020-07-23 07:19:00,572 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:19:01,573 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:19:01,638 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:19:01,661 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:19:01,661 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:19:02,573 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 securityworker stdout | 2020-07-23 07:19:03,477 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run securityworker stdout | 2020-07-23 07:19:03,478 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:33.476607+00:00 (in 29.998882 seconds) 2020-07-23 07:19:03,478 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:19:33 UTC)" (scheduled at 2020-07-23 07:19:03.476607+00:00) 2020-07-23 07:19:03,478 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:19:33 UTC)" executed successfully builder stdout | 2020-07-23 07:19:03,573 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 exportactionlogsworker stdout | 2020-07-23 07:19:03,972 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:19:03,972 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:08.212267+00:00 (in 4.239643 seconds) 2020-07-23 07:19:03,973 [99] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:20:03 UTC)" (scheduled at 2020-07-23 07:19:03.971686+00:00) 2020-07-23 07:19:03,973 [99] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2020-07-23 07:19:03,976 [99] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 19, 3, 973724), True, datetime.datetime(2020, 7, 23, 7, 19, 3, 973724), 0, u'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2020-07-23 07:19:03,984 [99] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2020-07-23 07:19:03,985 [99] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:19:03,985 [99] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:20:03 UTC)" executed successfully builder stdout | 2020-07-23 07:19:04,574 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gcworker stdout | 2020-07-23 07:19:05,377 [110] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'gcworker.py', 'pid': '110'} builder stdout | 2020-07-23 07:19:05,574 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 expiredappspecifictokenworker stdout | 2020-07-23 07:19:05,744 [126] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '126'} securityworker stdout | 2020-07-23 07:19:06,410 [128] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'securityworker.py', 'pid': '128'} builder stdout | 2020-07-23 07:19:06,554 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 2020-07-23 07:19:06,555 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:19:05.574469 (running). builder stdout | 2020-07-23 07:19:06,574 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 teamsyncworker stdout | 2020-07-23 07:19:06,751 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'teamsyncworker.py', 'pid': '115'} namespacegcworker stdout | 2020-07-23 07:19:06,910 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:19:06,911 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:39.024941+00:00 (in 32.113940 seconds) 2020-07-23 07:19:06,911 [134] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:20:06 UTC)" (scheduled at 2020-07-23 07:19:06.910005+00:00) 2020-07-23 07:19:06,911 [134] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2020-07-23 07:19:06,913 [134] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 19, 6, 911873), True, datetime.datetime(2020, 7, 23, 7, 19, 6, 911873), 0, u'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2020-07-23 07:19:06,924 [134] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:19:06,924 [134] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:19:06,925 [134] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:20:06 UTC)" executed successfully builder stdout | 2020-07-23 07:19:07,574 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-secscan stdout | 2020-07-23 07:19:08,078 [413] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '413'} gunicorn-secscan stdout | 2020-07-23 07:19:08,094 [412] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '412'} gunicorn-secscan stdout | 2020-07-23 07:19:08,119 [122] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '122'} gunicorn-secscan stdout | 2020-07-23 07:19:08,128 [411] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '411'} gunicorn-secscan stdout | 2020-07-23 07:19:08,132 [414] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '414'} exportactionlogsworker stdout | 2020-07-23 07:19:08,142 [99] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'exportactionlogsworker.py', 'pid': '99'} exportactionlogsworker stdout | 2020-07-23 07:19:08,213 [99] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2020-07-23 07:19:08,213 [99] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:20:08 UTC)" (scheduled at 2020-07-23 07:19:08.212267+00:00) 2020-07-23 07:19:08,214 [99] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:19:08,214 [99] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:20:03.971686+00:00 (in 55.758382 seconds) exportactionlogsworker stdout | 2020-07-23 07:19:08,214 [99] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:20:08 UTC)" executed successfully repositoryactioncounter stdout | 2020-07-23 07:19:08,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:19:08,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:18.291018+00:00 (in 9.999000 seconds) 2020-07-23 07:19:08,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:19:18 UTC)" (scheduled at 2020-07-23 07:19:08.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:19:08,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:19:08,304 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:19:08,304 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:19:08,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:19:18 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:19:08,383 [435] [DEBUG] [app] Starting request: urn:request:083c08d5-4841-4211-978c-23d89120ee74 (/health/instance) gunicorn-web stdout | 2020-07-23 07:19:08,386 [435] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:19:08,392 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:19:08,394 [463] [DEBUG] [app] Starting request: urn:request:01f42c27-a46a-4d0b-aeb5-6e146f509733 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:19:08,396 [463] [DEBUG] [app] Ending request: urn:request:01f42c27-a46a-4d0b-aeb5-6e146f509733 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:19:08,396 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:08 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:19:08,397 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:08 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:19:08,398 [435] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:19:08,405 [435] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:19:08,415 [435] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:19:08,422 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:19:08,424 [419] [DEBUG] [app] Starting request: urn:request:5d01df21-e025-4ab6-80b9-ba152104e48e (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:19:08,425 [419] [DEBUG] [app] Ending request: urn:request:5d01df21-e025-4ab6-80b9-ba152104e48e (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:19:08,426 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:08 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:08 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:19:08,426 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:19:08,431 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:19:08,432 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:08 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:19:08,435 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:08 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:19:08,437 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:19:08,441 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:19:08,443 [468] [DEBUG] [app] Starting request: urn:request:99efdacd-2ca0-4a20-acdb-9d4bcbb20be7 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:19:08,445 [468] [DEBUG] [app] Ending request: urn:request:99efdacd-2ca0-4a20-acdb-9d4bcbb20be7 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:19:08,446 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:08 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:19:08,445 [468] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:08 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:19:08,448 [435] [DEBUG] [app] Ending request: urn:request:083c08d5-4841-4211-978c-23d89120ee74 (/health/instance) 2020-07-23 07:19:08,448 [435] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:19:08,449 [435] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:19:08 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:19:08 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.069 49 0.069) builder stdout | 2020-07-23 07:19:08,574 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 queuecleanupworker stdout | 2020-07-23 07:19:08,668 [103] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'queuecleanupworker.py', 'pid': '103'} gunicorn-web stdout | 2020-07-23 07:19:09,385 [438] [DEBUG] [app] Starting request: urn:request:0e71bad9-30c6-423e-a522-7867af2d661e (/health/instance) gunicorn-web stdout | 2020-07-23 07:19:09,388 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:19:09,394 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:19:09,396 [475] [DEBUG] [app] Starting request: urn:request:e8d1270c-128d-4421-8b4b-58193353d56a (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:19:09,397 [475] [DEBUG] [app] Ending request: urn:request:e8d1270c-128d-4421-8b4b-58193353d56a (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-registry stdout | 2020-07-23 07:19:09,398 [475] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:09 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:19:09,399 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:19:09,400 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:19:09,406 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:19:09,415 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:19:09,422 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:19:09,424 [438] [DEBUG] [app] Starting request: urn:request:fa688e19-e7ec-40a6-91e1-d9ecbdef509c (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:19:09,425 [438] [DEBUG] [app] Ending request: urn:request:fa688e19-e7ec-40a6-91e1-d9ecbdef509c (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:19:09,426 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:09 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:09 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:19:09,427 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 globalpromstats stdout | 2020-07-23 07:19:09,429 [129] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'globalpromstats.py', 'pid': '129'} gunicorn-web stdout | 2020-07-23 07:19:09,431 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:09 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:19:09,432 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:19:09,435 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:09 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:19:09,437 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:19:09,441 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:19:09,443 [468] [DEBUG] [app] Starting request: urn:request:f8d9e2bf-a5fd-460c-8c90-6f2055b45f0c (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:19:09,445 [468] [DEBUG] [app] Ending request: urn:request:f8d9e2bf-a5fd-460c-8c90-6f2055b45f0c (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:09 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:19:09,445 [468] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:09 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:19:09,446 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:19:09,448 [438] [DEBUG] [app] Ending request: urn:request:0e71bad9-30c6-423e-a522-7867af2d661e (/health/instance) 2020-07-23 07:19:09,448 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:19:09,449 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:19:09 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:19:09 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.066 49 0.066) builder stdout | 2020-07-23 07:19:09,575 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 buildlogsarchiver stdout | 2020-07-23 07:19:09,786 [109] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'buildlogsarchiver.py', 'pid': '109'} notificationworker stdout | 2020-07-23 07:19:09,912 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:19:09,913 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:11.998621+00:00 (in 2.085850 seconds) 2020-07-23 07:19:09,913 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:19:19 UTC)" (scheduled at 2020-07-23 07:19:09.911177+00:00) 2020-07-23 07:19:09,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:19:09,916 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 19, 9, 913784), True, datetime.datetime(2020, 7, 23, 7, 19, 9, 913784), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:19:09,927 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:19:09,927 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:19:09,927 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:19:19 UTC)" executed successfully gcworker stdout | 2020-07-23 07:19:10,005 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:19:10,006 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:40.004697+00:00 (in 29.998596 seconds) gcworker stdout | 2020-07-23 07:19:10,006 [110] [INFO] [apscheduler.executors.default] Running job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:19:40 UTC)" (scheduled at 2020-07-23 07:19:10.004697+00:00) gcworker stdout | 2020-07-23 07:19:10,009 [110] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1594279150007, 1209600, 500, 1, 0]) notificationworker stdout | 2020-07-23 07:19:10,017 [113] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'notificationworker.py', 'pid': '113'} gcworker stdout | 2020-07-23 07:19:10,020 [110] [DEBUG] [__main__] No repository with garbage found 2020-07-23 07:19:10,020 [110] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2020-07-23 07:19:10,020 [110] [INFO] [apscheduler.executors.default] Job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:19:40 UTC)" executed successfully chunkcleanupworker stdout | 2020-07-23 07:19:10,235 [124] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'chunkcleanupworker.py', 'pid': '124'} builder stdout | 2020-07-23 07:19:10,575 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:19:11,518 [130] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'builder.py', 'pid': '130'} builder stdout | 2020-07-23 07:19:11,575 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:19:11,662 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:19:11,676 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:19:11,676 [130] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2020-07-23 07:19:11,699 [134] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'namespacegcworker.py', 'pid': '134'} repositorygcworker stdout | 2020-07-23 07:19:11,745 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositorygcworker.py', 'pid': '102'} notificationworker stdout | 2020-07-23 07:19:11,999 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:19:12,000 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:19.911177+00:00 (in 7.911195 seconds) 2020-07-23 07:19:12,000 [113] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:20:11 UTC)" (scheduled at 2020-07-23 07:19:11.998621+00:00) 2020-07-23 07:19:12,000 [113] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:19:12,001 [113] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:20:11 UTC)" executed successfully blobuploadcleanupworker stdout | 2020-07-23 07:19:12,213 [119] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'blobuploadcleanupworker.py', 'pid': '119'} builder stdout | 2020-07-23 07:19:12,575 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:19:13,576 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 security_notification_worker stdout | 2020-07-23 07:19:13,724 [101] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'security_notification_worker.py', 'pid': '101'} storagereplication stdout | 2020-07-23 07:19:13,752 [133] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'storagereplication.py', 'pid': '133'} logrotateworker stdout | 2020-07-23 07:19:13,757 [118] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'logrotateworker.py', 'pid': '118'} builder stdout | 2020-07-23 07:19:14,576 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:19:15,071 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositoryactioncounter.py', 'pid': '114'} builder stdout | 2020-07-23 07:19:15,576 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 servicekey stdout | 2020-07-23 07:19:15,745 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'servicekeyworker.py', 'pid': '98'} gunicorn-web stdout | 2020-07-23 07:19:15,952 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '104'} gunicorn-web stdout | 2020-07-23 07:19:15,967 [435] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '435'} gunicorn-web stdout | 2020-07-23 07:19:16,014 [419] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '419'} gunicorn-web stdout | 2020-07-23 07:19:16,030 [433] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '433'} gunicorn-web stdout | 2020-07-23 07:19:16,036 [431] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '431'} gunicorn-web stdout | 2020-07-23 07:19:16,062 [438] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '438'} gunicorn-web stdout | 2020-07-23 07:19:16,068 [420] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '420'} gunicorn-web stdout | 2020-07-23 07:19:16,074 [436] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '436'} gunicorn-web stdout | 2020-07-23 07:19:16,079 [423] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '423'} builder stdout | 2020-07-23 07:19:16,557 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 2020-07-23 07:19:16,557 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:19:15.576688 (running). builder stdout | 2020-07-23 07:19:16,576 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:19:17,576 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:19:18,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:19:18,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:28.291018+00:00 (in 9.999148 seconds) 2020-07-23 07:19:18,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:19:28 UTC)" (scheduled at 2020-07-23 07:19:18.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:19:18,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:19:18,304 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:19:18,304 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:19:18,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:19:28 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:19:18,382 [438] [DEBUG] [app] Starting request: urn:request:e3b978ca-ba59-442a-bafc-0cb241f7f53c (/health/instance) gunicorn-web stdout | 2020-07-23 07:19:18,385 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:19:18,393 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:19:18,395 [463] [DEBUG] [app] Starting request: urn:request:c46e057b-5e66-4835-9e50-3cdb2391dbe2 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:19:18,396 [463] [DEBUG] [app] Ending request: urn:request:c46e057b-5e66-4835-9e50-3cdb2391dbe2 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:18 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-registry stdout | 2020-07-23 07:19:18,397 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:18 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:19:18,397 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:19:18,398 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:19:18,404 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:19:18,412 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:19:18,416 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:19:18,418 [433] [DEBUG] [app] Starting request: urn:request:8820522c-2bd7-4568-ae96-f59bff8ae95e (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:19:18,419 [433] [DEBUG] [app] Ending request: urn:request:8820522c-2bd7-4568-ae96-f59bff8ae95e (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:19:18,420 [433] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:18 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:19:18,420 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:18 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:19:18,424 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:18 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:19:18,425 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:19:18,429 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:18 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:19:18,430 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:19:18,434 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:19:18,436 [466] [DEBUG] [app] Starting request: urn:request:24a5dbd5-95a3-4568-9368-3772649560ce (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:19:18,437 [466] [DEBUG] [app] Ending request: urn:request:24a5dbd5-95a3-4568-9368-3772649560ce (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:18 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:19:18,438 [466] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:18 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:19:18,438 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:19:18,440 [438] [DEBUG] [app] Ending request: urn:request:e3b978ca-ba59-442a-bafc-0cb241f7f53c (/health/instance) gunicorn-web stdout | 2020-07-23 07:19:18,441 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:19:18,441 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:19:18 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:19:18 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.060 49 0.060) builder stdout | 2020-07-23 07:19:18,577 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:19:19,384 [435] [DEBUG] [app] Starting request: urn:request:7abd8bf9-1f5c-4e8f-876e-118b5392d943 (/health/instance) gunicorn-web stdout | 2020-07-23 07:19:19,386 [435] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:19:19,391 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:19:19,393 [475] [DEBUG] [app] Starting request: urn:request:a33ac25f-85f6-41bd-b273-da7e0ad4969b (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:19:19,394 [475] [DEBUG] [app] Ending request: urn:request:a33ac25f-85f6-41bd-b273-da7e0ad4969b (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:19:19,395 [475] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:19 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:19 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:19:19,395 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:19:19,396 [435] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:19:19,402 [435] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:19:19,410 [435] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:19:19,415 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:19:19,417 [435] [DEBUG] [app] Starting request: urn:request:1c0102e2-0578-4aa0-a4eb-55cb63725069 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:19:19,418 [435] [DEBUG] [app] Ending request: urn:request:1c0102e2-0578-4aa0-a4eb-55cb63725069 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:19:19,419 [435] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:19 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:19 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:19:19,419 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:19:19,423 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:19 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:19:19,424 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:19:19,427 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:19:19,428 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:19 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:19:19,432 [435] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:19:19,434 [461] [DEBUG] [app] Starting request: urn:request:a9dbdcc8-d78d-4a9e-b964-9789eeee82ab (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:19:19,435 [461] [DEBUG] [app] Ending request: urn:request:a9dbdcc8-d78d-4a9e-b964-9789eeee82ab (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:19:19,436 [461] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:19 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:19 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:19:19,437 [435] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:19:19,439 [435] [DEBUG] [app] Ending request: urn:request:7abd8bf9-1f5c-4e8f-876e-118b5392d943 (/health/instance) gunicorn-web stdout | 2020-07-23 07:19:19,440 [435] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:19:19,441 [435] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:19:19 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:19:19 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.058 49 0.058) builder stdout | 2020-07-23 07:19:19,577 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:19:19,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:19:19,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:29.911177+00:00 (in 9.999068 seconds) notificationworker stdout | 2020-07-23 07:19:19,913 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:19:29 UTC)" (scheduled at 2020-07-23 07:19:19.911177+00:00) 2020-07-23 07:19:19,913 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:19:19,916 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 19, 19, 913351), True, datetime.datetime(2020, 7, 23, 7, 19, 19, 913351), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:19:19,926 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:19:19,926 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:19:19,926 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:19:29 UTC)" executed successfully builder stdout | 2020-07-23 07:19:20,577 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:19:20,953 [130] [DEBUG] [buildman.server] Writing metrics builder stdout | 2020-07-23 07:19:20,968 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds builder stdout | 2020-07-23 07:19:21,577 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:19:21,678 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:19:21,684 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:19:21,684 [130] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2020-07-23 07:19:21,739 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:19:21,740 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:28.907644+00:00 (in 7.167509 seconds) 2020-07-23 07:19:21,740 [102] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:20:21 UTC)" (scheduled at 2020-07-23 07:19:21.739118+00:00) 2020-07-23 07:19:21,741 [102] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2020-07-23 07:19:21,743 [102] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 19, 21, 741142), True, datetime.datetime(2020, 7, 23, 7, 19, 21, 741142), 0, u'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2020-07-23 07:19:21,751 [102] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2020-07-23 07:19:21,751 [102] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:19:21,752 [102] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:01:00], next run at: 2020-07-23 07:20:21 UTC)" executed successfully builder stdout | 2020-07-23 07:19:22,577 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-registry stdout | 2020-07-23 07:19:22,683 [469] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '469'} gunicorn-registry stdout | 2020-07-23 07:19:22,709 [100] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '100'} gunicorn-registry stdout | 2020-07-23 07:19:22,745 [463] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '463'} gunicorn-registry stdout | 2020-07-23 07:19:22,756 [477] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '477'} gunicorn-registry stdout | 2020-07-23 07:19:22,766 [478] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '478'} gunicorn-registry stdout | 2020-07-23 07:19:22,785 [470] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '470'} gunicorn-registry stdout | 2020-07-23 07:19:22,797 [476] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '476'} gunicorn-registry stdout | 2020-07-23 07:19:22,804 [480] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '480'} gunicorn-registry stdout | 2020-07-23 07:19:22,830 [467] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '467'} gunicorn-registry stdout | 2020-07-23 07:19:22,839 [475] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '475'} gunicorn-registry stdout | 2020-07-23 07:19:22,845 [479] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '479'} gunicorn-registry stdout | 2020-07-23 07:19:22,853 [474] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '474'} gunicorn-registry stdout | 2020-07-23 07:19:22,874 [472] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '472'} gunicorn-registry stdout | 2020-07-23 07:19:22,896 [465] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '465'} gunicorn-registry stdout | 2020-07-23 07:19:22,901 [473] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '473'} gunicorn-registry stdout | 2020-07-23 07:19:22,909 [481] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '481'} gunicorn-registry stdout | 2020-07-23 07:19:22,913 [471] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '471'} builder stdout | 2020-07-23 07:19:23,578 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:19:24,579 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-verbs stdout | 2020-07-23 07:19:25,236 [127] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'verbs:application', 'pid': '127'} builder stdout | 2020-07-23 07:19:25,578 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 buildlogsarchiver stdout | 2020-07-23 07:19:26,396 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:19:26,396 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:56.395393+00:00 (in 29.999144 seconds) 2020-07-23 07:19:26,396 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:19:56 UTC)" (scheduled at 2020-07-23 07:19:26.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:19:26,398 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 19, 26, 397100), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:19:26,408 [109] [DEBUG] [__main__] No more builds to archive 2020-07-23 07:19:26,408 [109] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2020-07-23 07:19:26,408 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:19:56 UTC)" executed successfully builder stdout | 2020-07-23 07:19:26,559 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 2020-07-23 07:19:26,560 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:19:25.578774 (running). builder stdout | 2020-07-23 07:19:26,578 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:19:27,579 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:19:28,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:19:28,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:38.291018+00:00 (in 9.998923 seconds) 2020-07-23 07:19:28,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:19:38 UTC)" (scheduled at 2020-07-23 07:19:28.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:19:28,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:19:28,304 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:19:28,305 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:19:28,305 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:19:38 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:19:28,382 [438] [DEBUG] [app] Starting request: urn:request:599ad236-5e89-4f7e-873d-8c90d43f9401 (/health/instance) gunicorn-web stdout | 2020-07-23 07:19:28,385 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:19:28,390 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:19:28,392 [481] [DEBUG] [app] Starting request: urn:request:422537ae-b9ad-4b65-866a-4a13b704a33c (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:19:28,393 [481] [DEBUG] [app] Ending request: urn:request:422537ae-b9ad-4b65-866a-4a13b704a33c (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:19:28,394 [481] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:28 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:28 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:19:28,395 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:19:28,396 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:19:28,401 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:19:28,408 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:19:28,413 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:19:28,415 [438] [DEBUG] [app] Starting request: urn:request:7ebda92a-345b-43d3-b69c-dbc4bb9b30b1 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:19:28,416 [438] [DEBUG] [app] Ending request: urn:request:7ebda92a-345b-43d3-b69c-dbc4bb9b30b1 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:28 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:19:28,417 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:28 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:19:28,417 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:19:28,421 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:28 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:19:28,422 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:19:28,425 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:19:28,427 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:28 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:19:28,431 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:19:28,433 [461] [DEBUG] [app] Starting request: urn:request:f1487c81-347a-4b8e-8d7b-c5170e75e0a3 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:19:28,434 [461] [DEBUG] [app] Ending request: urn:request:f1487c81-347a-4b8e-8d7b-c5170e75e0a3 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:28 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:19:28,435 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-verbs stdout | 2020-07-23 07:19:28,435 [461] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:28 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:19:28,437 [438] [DEBUG] [app] Ending request: urn:request:599ad236-5e89-4f7e-873d-8c90d43f9401 (/health/instance) gunicorn-web stdout | 2020-07-23 07:19:28,438 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:19:28,438 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:19:28 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:19:28 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.058 49 0.058) builder stdout | 2020-07-23 07:19:28,586 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositorygcworker stdout | 2020-07-23 07:19:28,908 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2020-07-23 07:19:28,908 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:20:21.739118+00:00 (in 52.830495 seconds) 2020-07-23 07:19:28,909 [102] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:20:28 UTC)" (scheduled at 2020-07-23 07:19:28.907644+00:00) 2020-07-23 07:19:28,909 [102] [DEBUG] [workers.queueworker] Running watchdog. 2020-07-23 07:19:28,909 [102] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:20:28 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:19:29,384 [438] [DEBUG] [app] Starting request: urn:request:0f9123a2-9ae5-4c65-b695-406d9b4f33cc (/health/instance) gunicorn-web stdout | 2020-07-23 07:19:29,389 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:19:29,391 [470] [DEBUG] [app] Starting request: urn:request:2453210c-d7b0-49cc-b5e2-4383dd417f17 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:19:29,392 [470] [DEBUG] [app] Ending request: urn:request:2453210c-d7b0-49cc-b5e2-4383dd417f17 (/v1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:29 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-registry stdout | 2020-07-23 07:19:29,393 [470] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:29 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:19:29,393 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:19:29,394 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:19:29,399 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:19:29,406 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:19:29,412 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:19:29,414 [438] [DEBUG] [app] Starting request: urn:request:c13a3567-38f6-49e5-bf9a-5b86c3e04245 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:19:29,415 [438] [DEBUG] [app] Ending request: urn:request:c13a3567-38f6-49e5-bf9a-5b86c3e04245 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:19:29,416 [438] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:29 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:29 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:19:29,416 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:19:29,421 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:29 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:19:29,422 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:19:29,425 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:19:29,427 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:29 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:19:29,430 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:19:29,432 [461] [DEBUG] [app] Starting request: urn:request:a5a8c6ed-a83e-4c40-bf8d-4e8882aa013c (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:19:29,433 [461] [DEBUG] [app] Ending request: urn:request:a5a8c6ed-a83e-4c40-bf8d-4e8882aa013c (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:19:29,434 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:29 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:19:29,434 [461] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:29 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:19:29,436 [438] [DEBUG] [app] Ending request: urn:request:0f9123a2-9ae5-4c65-b695-406d9b4f33cc (/health/instance) 2020-07-23 07:19:29,436 [438] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:19:29 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.054 49 0.054) gunicorn-web stdout | 2020-07-23 07:19:29,437 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:19:29 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" builder stdout | 2020-07-23 07:19:29,579 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:19:29,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:19:29,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:39.911177+00:00 (in 9.999045 seconds) 2020-07-23 07:19:29,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:19:39 UTC)" (scheduled at 2020-07-23 07:19:29.911177+00:00) 2020-07-23 07:19:29,912 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:19:29,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 19, 29, 912986), True, datetime.datetime(2020, 7, 23, 7, 19, 29, 912986), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:19:29,924 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:19:29,925 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:19:29,925 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:19:39 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:19:30,352 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:19:30,353 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:50.446184+00:00 (in 20.093229 seconds) 2020-07-23 07:19:30,353 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:20:00 UTC)" (scheduled at 2020-07-23 07:19:30.351857+00:00) 2020-07-23 07:19:30,354 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:19:30,356 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 19, 30, 354125), True, datetime.datetime(2020, 7, 23, 7, 19, 30, 354125), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:19:30,365 [101] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:19:30,365 [101] [DEBUG] [data.database] Disconnecting from database. security_notification_worker stdout | 2020-07-23 07:19:30,365 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:20:00 UTC)" executed successfully builder stdout | 2020-07-23 07:19:30,579 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:19:31,580 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:19:31,685 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:19:31,699 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:19:31,700 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:19:32,580 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 securityworker stdout | 2020-07-23 07:19:33,477 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run securityworker stdout | 2020-07-23 07:19:33,478 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:20:03.476607+00:00 (in 29.998862 seconds) 2020-07-23 07:19:33,478 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:20:03 UTC)" (scheduled at 2020-07-23 07:19:33.476607+00:00) 2020-07-23 07:19:33,478 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:20:03 UTC)" executed successfully builder stdout | 2020-07-23 07:19:33,580 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:19:34,580 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gcworker stdout | 2020-07-23 07:19:35,419 [110] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'gcworker.py', 'pid': '110'} builder stdout | 2020-07-23 07:19:35,580 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 expiredappspecifictokenworker stdout | 2020-07-23 07:19:35,784 [126] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '126'} securityworker stdout | 2020-07-23 07:19:36,448 [128] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'securityworker.py', 'pid': '128'} builder stdout | 2020-07-23 07:19:36,562 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 2020-07-23 07:19:36,562 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:19:35.581182 (running). builder stdout | 2020-07-23 07:19:36,581 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 teamsyncworker stdout | 2020-07-23 07:19:36,765 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'teamsyncworker.py', 'pid': '115'} builder stdout | 2020-07-23 07:19:37,581 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-secscan stdout | 2020-07-23 07:19:38,088 [413] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '413'} gunicorn-secscan stdout | 2020-07-23 07:19:38,103 [412] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '412'} gunicorn-secscan stdout | 2020-07-23 07:19:38,129 [122] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '122'} gunicorn-secscan stdout | 2020-07-23 07:19:38,140 [411] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '411'} gunicorn-secscan stdout | 2020-07-23 07:19:38,145 [414] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'secscan:application', 'pid': '414'} exportactionlogsworker stdout | 2020-07-23 07:19:38,182 [99] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'exportactionlogsworker.py', 'pid': '99'} repositoryactioncounter stdout | 2020-07-23 07:19:38,292 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:19:38,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:48.291018+00:00 (in 9.998386 seconds) 2020-07-23 07:19:38,293 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:19:48 UTC)" (scheduled at 2020-07-23 07:19:38.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:19:38,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:19:38,304 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:19:38,304 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:19:38,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:19:48 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:19:38,382 [438] [DEBUG] [app] Starting request: urn:request:d4b1af15-cb35-4793-bf38-6300f400333d (/health/instance) gunicorn-web stdout | 2020-07-23 07:19:38,385 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:19:38,390 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:19:38,393 [481] [DEBUG] [app] Starting request: urn:request:de889951-2f02-49cb-8f36-303aa6c4429a (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:19:38,394 [481] [DEBUG] [app] Ending request: urn:request:de889951-2f02-49cb-8f36-303aa6c4429a (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:19:38,395 [481] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:38 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:38 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:19:38,395 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:19:38,396 [438] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:19:38,403 [438] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:19:38,411 [438] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:19:38,416 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:19:38,418 [419] [DEBUG] [app] Starting request: urn:request:b13c055c-9f7c-4901-8d88-b1022f52da7a (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:19:38,419 [419] [DEBUG] [app] Ending request: urn:request:b13c055c-9f7c-4901-8d88-b1022f52da7a (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:19:38,420 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:38 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:38 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:19:38,421 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:19:38,425 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:38 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:19:38,426 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:19:38,430 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:38 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:19:38,432 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:19:38,436 [438] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:19:38,438 [462] [DEBUG] [app] Starting request: urn:request:484f2483-92a0-40f2-b040-50abd6470f24 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:19:38,440 [462] [DEBUG] [app] Ending request: urn:request:484f2483-92a0-40f2-b040-50abd6470f24 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:38 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:19:38,440 [462] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:38 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:19:38,441 [438] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:19:38,443 [438] [DEBUG] [app] Ending request: urn:request:d4b1af15-cb35-4793-bf38-6300f400333d (/health/instance) 2020-07-23 07:19:38,443 [438] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:19:38,444 [438] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:19:38 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:19:38 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.063 49 0.063) builder stdout | 2020-07-23 07:19:38,581 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 queuecleanupworker stdout | 2020-07-23 07:19:38,706 [103] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'queuecleanupworker.py', 'pid': '103'} namespacegcworker stdout | 2020-07-23 07:19:39,025 [134] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2020-07-23 07:19:39,026 [134] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:20:06.910005+00:00 (in 27.884146 seconds) 2020-07-23 07:19:39,026 [134] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:20:39 UTC)" (scheduled at 2020-07-23 07:19:39.024941+00:00) 2020-07-23 07:19:39,026 [134] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2020-07-23 07:19:39,026 [134] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:20:39 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:19:39,384 [436] [DEBUG] [app] Starting request: urn:request:521fcb20-df89-4fd6-94a7-39f27e3e91e5 (/health/instance) gunicorn-web stdout | 2020-07-23 07:19:39,387 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:19:39,393 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:19:39,395 [470] [DEBUG] [app] Starting request: urn:request:84cb4c3f-e1bc-4a70-81e3-1b3e54fc85ef (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:19:39,396 [470] [DEBUG] [app] Ending request: urn:request:84cb4c3f-e1bc-4a70-81e3-1b3e54fc85ef (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:19:39,397 [470] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:39 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 162 0.004) gunicorn-web stdout | 2020-07-23 07:19:39,397 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:19:39,399 [436] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:19:39,405 [436] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:19:39,413 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:19:39,418 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:19:39,420 [419] [DEBUG] [app] Starting request: urn:request:612d1509-ca9a-40a2-9072-a484e5069ced (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:19:39,421 [419] [DEBUG] [app] Ending request: urn:request:612d1509-ca9a-40a2-9072-a484e5069ced (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:19:39,422 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:39 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:19:39,422 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:39 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 159 0.002) gunicorn-web stdout | 2020-07-23 07:19:39,426 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:39 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:19:39,427 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:19:39,430 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:39 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:19:39,433 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:19:39,436 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:19:39,438 [462] [DEBUG] [app] Starting request: urn:request:02d130f6-0a65-40c7-b6b1-58c57b2d6feb (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:19:39,439 [462] [DEBUG] [app] Ending request: urn:request:02d130f6-0a65-40c7-b6b1-58c57b2d6feb (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:19:39,440 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:39 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 162 0.002) gunicorn-verbs stdout | 2020-07-23 07:19:39,439 [462] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:39 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:19:39,441 [436] [DEBUG] [app] Ending request: urn:request:521fcb20-df89-4fd6-94a7-39f27e3e91e5 (/health/instance) gunicorn-web stdout | 2020-07-23 07:19:39,441 [436] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:19:39,442 [436] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:19:39 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:19:39 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.059 49 0.059) globalpromstats stdout | 2020-07-23 07:19:39,468 [129] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'globalpromstats.py', 'pid': '129'} builder stdout | 2020-07-23 07:19:39,581 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 buildlogsarchiver stdout | 2020-07-23 07:19:39,824 [109] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'buildlogsarchiver.py', 'pid': '109'} notificationworker stdout | 2020-07-23 07:19:39,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:19:39,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:49.911177+00:00 (in 9.999196 seconds) 2020-07-23 07:19:39,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:19:49 UTC)" (scheduled at 2020-07-23 07:19:39.911177+00:00) 2020-07-23 07:19:39,912 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:19:39,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 19, 39, 912832), True, datetime.datetime(2020, 7, 23, 7, 19, 39, 912832), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:19:39,924 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:19:39,924 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:19:39,925 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:19:49 UTC)" executed successfully gcworker stdout | 2020-07-23 07:19:40,005 [110] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2020-07-23 07:19:40,006 [110] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:20:10.004697+00:00 (in 29.998951 seconds) 2020-07-23 07:19:40,006 [110] [INFO] [apscheduler.executors.default] Running job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:20:10 UTC)" (scheduled at 2020-07-23 07:19:40.004697+00:00) gcworker stdout | 2020-07-23 07:19:40,008 [110] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1594279180006, 1209600, 500, 1, 0]) gcworker stdout | 2020-07-23 07:19:40,018 [110] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2020-07-23 07:19:40,018 [110] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:19:40,018 [110] [INFO] [apscheduler.executors.default] Job "_garbage_collection_repos (trigger: interval[0:00:30], next run at: 2020-07-23 07:20:10 UTC)" executed successfully notificationworker stdout | 2020-07-23 07:19:40,057 [113] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'notificationworker.py', 'pid': '113'} chunkcleanupworker stdout | 2020-07-23 07:19:40,274 [124] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'chunkcleanupworker.py', 'pid': '124'} builder stdout | 2020-07-23 07:19:40,582 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:19:41,556 [130] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'builder.py', 'pid': '130'} builder stdout | 2020-07-23 07:19:41,582 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:19:41,702 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:19:41,713 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:19:41,713 [130] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2020-07-23 07:19:41,730 [134] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'namespacegcworker.py', 'pid': '134'} repositorygcworker stdout | 2020-07-23 07:19:41,783 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositorygcworker.py', 'pid': '102'} blobuploadcleanupworker stdout | 2020-07-23 07:19:42,249 [119] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'blobuploadcleanupworker.py', 'pid': '119'} builder stdout | 2020-07-23 07:19:42,582 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:19:43,582 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 security_notification_worker stdout | 2020-07-23 07:19:43,755 [101] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'security_notification_worker.py', 'pid': '101'} storagereplication stdout | 2020-07-23 07:19:43,790 [133] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'storagereplication.py', 'pid': '133'} logrotateworker stdout | 2020-07-23 07:19:43,795 [118] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'logrotateworker.py', 'pid': '118'} builder stdout | 2020-07-23 07:19:44,583 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:19:45,105 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'repositoryactioncounter.py', 'pid': '114'} builder stdout | 2020-07-23 07:19:45,583 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 servicekey stdout | 2020-07-23 07:19:45,785 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'servicekeyworker.py', 'pid': '98'} gunicorn-web stdout | 2020-07-23 07:19:45,963 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '104'} gunicorn-web stdout | 2020-07-23 07:19:45,977 [435] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '435'} gunicorn-web stdout | 2020-07-23 07:19:46,029 [419] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '419'} gunicorn-web stdout | 2020-07-23 07:19:46,046 [433] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '433'} gunicorn-web stdout | 2020-07-23 07:19:46,051 [431] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '431'} gunicorn-web stdout | 2020-07-23 07:19:46,082 [438] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '438'} gunicorn-web stdout | 2020-07-23 07:19:46,092 [420] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '420'} gunicorn-web stdout | 2020-07-23 07:19:46,102 [436] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '436'} gunicorn-web stdout | 2020-07-23 07:19:46,107 [423] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'web:application', 'pid': '423'} builder stdout | 2020-07-23 07:19:46,564 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:19:46,564 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:19:45.583476 (running). builder stdout | 2020-07-23 07:19:46,583 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:19:47,583 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:19:48,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:19:48,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:58.291018+00:00 (in 9.999009 seconds) 2020-07-23 07:19:48,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:19:58 UTC)" (scheduled at 2020-07-23 07:19:48.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:19:48,294 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:19:48,304 [114] [DEBUG] [__main__] No further repositories to count repositoryactioncounter stdout | 2020-07-23 07:19:48,304 [114] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:19:48,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:19:58 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:19:48,383 [419] [DEBUG] [app] Starting request: urn:request:d322f308-adc8-42dd-9497-eca546c30002 (/health/instance) 2020-07-23 07:19:48,386 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:19:48,393 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:19:48,395 [477] [DEBUG] [app] Starting request: urn:request:2cbcb524-2d82-48ee-a15b-40dbda471723 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:19:48,397 [477] [DEBUG] [app] Ending request: urn:request:2cbcb524-2d82-48ee-a15b-40dbda471723 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:19:48,398 [477] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:48 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:19:48,398 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:19:48,400 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:19:48,407 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:19:48,415 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:19:48,420 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:19:48,422 [419] [DEBUG] [app] Starting request: urn:request:0f8965cc-1a72-4ae2-8dca-f73e5644c5b2 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:19:48,423 [419] [DEBUG] [app] Ending request: urn:request:0f8965cc-1a72-4ae2-8dca-f73e5644c5b2 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:19:48,424 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:48 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:48 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:19:48,425 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:19:48,429 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:19:48,429 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:48 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:19:48,433 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:48 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:19:48,434 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:19:48,438 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:19:48,440 [461] [DEBUG] [app] Starting request: urn:request:c001d528-7df1-490a-92ea-3b26d56779ef (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:19:48,441 [461] [DEBUG] [app] Ending request: urn:request:c001d528-7df1-490a-92ea-3b26d56779ef (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:19:48,442 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:48 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.002 162 0.002) gunicorn-verbs stdout | 2020-07-23 07:19:48,442 [461] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:48 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:19:48,444 [419] [DEBUG] [app] Ending request: urn:request:d322f308-adc8-42dd-9497-eca546c30002 (/health/instance) 2020-07-23 07:19:48,444 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:19:48,445 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:19:48 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:19:48 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.064 49 0.064) builder stdout | 2020-07-23 07:19:48,583 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:19:49,385 [436] [DEBUG] [app] Starting request: urn:request:e9c77ff2-8d14-481b-b4f0-ee9398b552ea (/health/instance) gunicorn-web stdout | 2020-07-23 07:19:49,387 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:19:49,393 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:19:49,394 [481] [DEBUG] [app] Starting request: urn:request:7622036d-1d29-4dc7-83bf-39516a2d0df7 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:19:49,395 [481] [DEBUG] [app] Ending request: urn:request:7622036d-1d29-4dc7-83bf-39516a2d0df7 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:19:49,396 [481] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:49 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:49 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:19:49,396 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:19:49,397 [436] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:19:49,403 [436] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:19:49,411 [436] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:19:49,417 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:19:49,419 [435] [DEBUG] [app] Starting request: urn:request:08a07bba-7482-49c0-8442-ea20415d6d8b (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:19:49,420 [435] [DEBUG] [app] Ending request: urn:request:08a07bba-7482-49c0-8442-ea20415d6d8b (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:19:49,421 [435] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:49 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:49 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.004 159 0.004) gunicorn-web stdout | 2020-07-23 07:19:49,422 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:19:49,426 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:19:49,427 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:49 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:19:49,431 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:19:49,432 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:49 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.001 153 0.001) gunicorn-web stdout | 2020-07-23 07:19:49,437 [436] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:19:49,439 [462] [DEBUG] [app] Starting request: urn:request:d4b388be-9e0e-4bc3-9ea8-8783dc458373 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:19:49,440 [462] [DEBUG] [app] Ending request: urn:request:d4b388be-9e0e-4bc3-9ea8-8783dc458373 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:49 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:19:49,441 [462] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:49 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:19:49,441 [436] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:19:49,443 [436] [DEBUG] [app] Ending request: urn:request:e9c77ff2-8d14-481b-b4f0-ee9398b552ea (/health/instance) 2020-07-23 07:19:49,443 [436] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:19:49,443 [436] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:19:49 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:19:49 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.061 49 0.061) builder stdout | 2020-07-23 07:19:49,584 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:19:49,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:19:49,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:59.911177+00:00 (in 9.999051 seconds) 2020-07-23 07:19:49,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:19:59 UTC)" (scheduled at 2020-07-23 07:19:49.911177+00:00) 2020-07-23 07:19:49,912 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:19:49,915 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 19, 49, 913037), True, datetime.datetime(2020, 7, 23, 7, 19, 49, 913037), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:19:49,926 [113] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2020-07-23 07:19:49,927 [113] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:19:49,927 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:19:59 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:19:50,446 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:19:50,447 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:19:52.446816+00:00 (in 1.999593 seconds) 2020-07-23 07:19:50,448 [101] [INFO] [apscheduler.executors.default] Running job "update_queue_metrics (trigger: interval[0:05:00], next run at: 2020-07-23 07:24:50 UTC)" (scheduled at 2020-07-23 07:19:50.446184+00:00) security_notification_worker stdout | 2020-07-23 07:19:50,449 [101] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2020, 7, 23, 7, 19, 50, 448211), u'security_notification/%']) security_notification_worker stdout | 2020-07-23 07:19:50,458 [101] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2020, 7, 23, 7, 19, 50, 448211), True, datetime.datetime(2020, 7, 23, 7, 19, 50, 448211), 0, u'security_notification/%']) security_notification_worker stdout | 2020-07-23 07:19:50,463 [101] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2020, 7, 23, 7, 19, 50, 448211), True, datetime.datetime(2020, 7, 23, 7, 19, 50, 448211), 0, u'security_notification/%', False, datetime.datetime(2020, 7, 23, 7, 19, 50, 448211), u'security_notification/%']) security_notification_worker stdout | 2020-07-23 07:19:50,465 [101] [DEBUG] [data.database] Disconnecting from database. security_notification_worker stdout | 2020-07-23 07:19:50,465 [101] [INFO] [apscheduler.executors.default] Job "update_queue_metrics (trigger: interval[0:05:00], next run at: 2020-07-23 07:24:50 UTC)" executed successfully builder stdout | 2020-07-23 07:19:50,584 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:19:50,970 [130] [DEBUG] [buildman.server] Writing metrics builder stdout | 2020-07-23 07:19:50,985 [130] [DEBUG] [buildman.server] Metrics going to sleep for 30 seconds builder stdout | 2020-07-23 07:19:51,584 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:19:51,715 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:19:51,721 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds 2020-07-23 07:19:51,722 [130] [DEBUG] [data.database] Disconnecting from database. security_notification_worker stdout | 2020-07-23 07:19:52,450 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:19:52,451 [101] [INFO] [apscheduler.executors.default] Running job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:20:52 UTC)" (scheduled at 2020-07-23 07:19:52.446816+00:00) 2020-07-23 07:19:52,451 [101] [DEBUG] [workers.queueworker] Running watchdog. security_notification_worker stdout | 2020-07-23 07:19:52,451 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:20:00.351857+00:00 (in 7.901224 seconds) 2020-07-23 07:19:52,451 [101] [INFO] [apscheduler.executors.default] Job "run_watchdog (trigger: interval[0:01:00], next run at: 2020-07-23 07:20:52 UTC)" executed successfully builder stdout | 2020-07-23 07:19:52,584 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-registry stdout | 2020-07-23 07:19:52,695 [469] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '469'} gunicorn-registry stdout | 2020-07-23 07:19:52,721 [100] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '100'} gunicorn-registry stdout | 2020-07-23 07:19:52,759 [463] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '463'} gunicorn-registry stdout | 2020-07-23 07:19:52,770 [477] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '477'} gunicorn-registry stdout | 2020-07-23 07:19:52,783 [478] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '478'} gunicorn-registry stdout | 2020-07-23 07:19:52,799 [470] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '470'} gunicorn-registry stdout | 2020-07-23 07:19:52,820 [476] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '476'} gunicorn-registry stdout | 2020-07-23 07:19:52,825 [480] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '480'} gunicorn-registry stdout | 2020-07-23 07:19:52,843 [467] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '467'} gunicorn-registry stdout | 2020-07-23 07:19:52,850 [475] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '475'} gunicorn-registry stdout | 2020-07-23 07:19:52,859 [479] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '479'} gunicorn-registry stdout | 2020-07-23 07:19:52,864 [474] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '474'} gunicorn-registry stdout | 2020-07-23 07:19:52,884 [472] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '472'} gunicorn-registry stdout | 2020-07-23 07:19:52,911 [465] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '465'} gunicorn-registry stdout | 2020-07-23 07:19:52,919 [473] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '473'} gunicorn-registry stdout | 2020-07-23 07:19:52,929 [471] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '471'} gunicorn-registry stdout | 2020-07-23 07:19:52,932 [481] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'registry:application', 'pid': '481'} builder stdout | 2020-07-23 07:19:53,585 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:19:54,585 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-verbs stdout | 2020-07-23 07:19:55,341 [127] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': 'demo-quayecosystem-quay-7cb576bbcb-wm9ph', 'process_name': 'verbs:application', 'pid': '127'} builder stdout | 2020-07-23 07:19:55,585 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 buildlogsarchiver stdout | 2020-07-23 07:19:56,396 [109] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2020-07-23 07:19:56,396 [109] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:20:26.395393+00:00 (in 29.998928 seconds) 2020-07-23 07:19:56,397 [109] [INFO] [apscheduler.executors.default] Running job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:20:26 UTC)" (scheduled at 2020-07-23 07:19:56.395393+00:00) buildlogsarchiver stdout | 2020-07-23 07:19:56,398 [109] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [u'complete', u'error', u'cancelled', datetime.datetime(2020, 7, 8, 7, 19, 56, 397394), False, 50, 1, 0]) buildlogsarchiver stdout | 2020-07-23 07:19:56,407 [109] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2020-07-23 07:19:56,407 [109] [DEBUG] [data.database] Disconnecting from database. 2020-07-23 07:19:56,407 [109] [INFO] [apscheduler.executors.default] Job "_archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2020-07-23 07:20:26 UTC)" executed successfully builder stdout | 2020-07-23 07:19:56,566 [130] [DEBUG] [buildman.component.buildcomponent] Checking heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 2020-07-23 07:19:56,566 [130] [DEBUG] [buildman.component.buildcomponent] Heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 is valid: 2020-07-23 07:19:55.585694 (running). builder stdout | 2020-07-23 07:19:56,585 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:19:57,585 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 repositoryactioncounter stdout | 2020-07-23 07:19:58,291 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2020-07-23 07:19:58,292 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:20:08.291018+00:00 (in 9.998913 seconds) 2020-07-23 07:19:58,292 [114] [INFO] [apscheduler.executors.default] Running job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:20:08 UTC)" (scheduled at 2020-07-23 07:19:58.291018+00:00) repositoryactioncounter stdout | 2020-07-23 07:19:58,295 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE NOT ("t1"."id" IN (SELECT "t2"."repository_id" FROM "repositoryactioncount" AS "t2" WHERE ("t2"."date" = %s))) ORDER BY Random() LIMIT %s OFFSET %s', [datetime.date(2020, 7, 22), 1, 0]) repositoryactioncounter stdout | 2020-07-23 07:19:58,304 [114] [DEBUG] [__main__] No further repositories to count 2020-07-23 07:19:58,304 [114] [DEBUG] [data.database] Disconnecting from database. repositoryactioncounter stdout | 2020-07-23 07:19:58,304 [114] [INFO] [apscheduler.executors.default] Job "wrapper (trigger: interval[0:00:10], next run at: 2020-07-23 07:20:08 UTC)" executed successfully gunicorn-web stdout | 2020-07-23 07:19:58,382 [419] [DEBUG] [app] Starting request: urn:request:75257432-91d0-4d82-a449-b1753ab8c2de (/health/instance) gunicorn-web stdout | 2020-07-23 07:19:58,384 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:19:58,389 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:19:58,391 [463] [DEBUG] [app] Starting request: urn:request:0e666d9f-a592-4cce-ae59-1fc2607705d5 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:19:58,392 [463] [DEBUG] [app] Ending request: urn:request:0e666d9f-a592-4cce-ae59-1fc2607705d5 (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:19:58,393 [463] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:19:58,393 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:58 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:19:58,395 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:19:58,400 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:19:58,407 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:19:58,413 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:19:58,415 [436] [DEBUG] [app] Starting request: urn:request:4b216887-9ed3-40f4-a915-11ff9bc000e3 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:19:58,416 [436] [DEBUG] [app] Ending request: urn:request:4b216887-9ed3-40f4-a915-11ff9bc000e3 (/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:58 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:19:58,417 [436] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:58 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" 2020-07-23 07:19:58,417 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:19:58,421 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:58 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:19:58,422 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 gunicorn-web stdout | 2020-07-23 07:19:58,426 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:58 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:19:58,427 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:19:58,431 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:19:58,433 [462] [DEBUG] [app] Starting request: urn:request:527851e4-0936-484c-a103-c3a87e9cca36 (/c1/_internal_ping) gunicorn-verbs stdout | 2020-07-23 07:19:58,434 [462] [DEBUG] [app] Ending request: urn:request:527851e4-0936-484c-a103-c3a87e9cca36 (/c1/_internal_ping) gunicorn-web stdout | 2020-07-23 07:19:58,434 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:58 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:19:58,434 [462] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:58 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:19:58,437 [419] [DEBUG] [app] Ending request: urn:request:75257432-91d0-4d82-a449-b1753ab8c2de (/health/instance) 2020-07-23 07:19:58,437 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:19:58,438 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:19:58 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:19:58 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.057 49 0.057) builder stdout | 2020-07-23 07:19:58,586 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 gunicorn-web stdout | 2020-07-23 07:19:59,384 [419] [DEBUG] [app] Starting request: urn:request:8dbe82bc-77b2-41dd-9979-77b8e71f7bfb (/health/instance) gunicorn-web stdout | 2020-07-23 07:19:59,388 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-registry stdout | 2020-07-23 07:19:59,390 [478] [DEBUG] [app] Starting request: urn:request:3928ff3f-4f81-4202-97a7-cbe0de66f09d (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:19:59,391 [478] [DEBUG] [app] Ending request: urn:request:3928ff3f-4f81-4202-97a7-cbe0de66f09d (/v1/_internal_ping) gunicorn-registry stdout | 2020-07-23 07:19:59,392 [478] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:59 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:59 +0000] "GET /v1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-web stdout | 2020-07-23 07:19:59,392 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /v1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:19:59,393 [419] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2020-07-23 07:19:59,398 [419] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1" LIMIT %s', [1]) gunicorn-web stdout | 2020-07-23 07:19:59,405 [419] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: localhost gunicorn-web stdout | 2020-07-23 07:19:59,411 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:19:59,413 [419] [DEBUG] [app] Starting request: urn:request:be515bbc-40b5-4cb0-924d-29b22b9b4642 (/_internal_ping) gunicorn-web stdout | 2020-07-23 07:19:59,414 [419] [DEBUG] [app] Ending request: urn:request:be515bbc-40b5-4cb0-924d-29b22b9b4642 (/_internal_ping) 2020-07-23 07:19:59,414 [419] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:59 +0000] "GET /_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:59 +0000] "GET /_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 159 0.003) gunicorn-web stdout | 2020-07-23 07:19:59,415 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:19:59,418 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-web stdout | 2020-07-23 07:19:59,419 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan HTTP/1.1" 301 185 nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:59 +0000] "GET /secscan HTTP/1.1" 301 185 "-" "python-requests/2.22.0" (0.000 152 -) gunicorn-web stdout | 2020-07-23 07:19:59,422 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:59 +0000] "GET /secscan/ HTTP/1.1" 403 55 "-" "python-requests/2.22.0" (0.000 153 0.000) gunicorn-web stdout | 2020-07-23 07:19:59,423 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /secscan/ HTTP/1.1" 403 55 gunicorn-web stdout | 2020-07-23 07:19:59,427 [419] [WARNING] [py.warnings] /opt/rh/python27/root/usr/lib/python2.7/site-packages/urllib3/connectionpool.py:851: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings InsecureRequestWarning) gunicorn-verbs stdout | 2020-07-23 07:19:59,428 [462] [DEBUG] [app] Starting request: urn:request:4ddc980e-a221-4ac6-a9f4-5ec35bfe3bf5 (/c1/_internal_ping) nginx stdout | 127.0.0.1 () - - [23/Jul/2020:07:19:59 +0000] "GET /c1/_internal_ping HTTP/1.1" 200 4 "-" "python-requests/2.22.0" (0.003 162 0.003) gunicorn-verbs stdout | 2020-07-23 07:19:59,430 [462] [DEBUG] [app] Ending request: urn:request:4ddc980e-a221-4ac6-a9f4-5ec35bfe3bf5 (/c1/_internal_ping) 2020-07-23 07:19:59,431 [462] [INFO] [gunicorn.access] 127.0.0.1 - - [23/Jul/2020:07:19:59 +0000] "GET /c1/_internal_ping HTTP/1.0" 200 4 "-" "python-requests/2.22.0" gunicorn-web stdout | 2020-07-23 07:19:59,431 [419] [DEBUG] [urllib3.connectionpool] https://localhost:8443 "GET /c1/_internal_ping HTTP/1.1" 200 4 gunicorn-web stdout | 2020-07-23 07:19:59,433 [419] [DEBUG] [app] Ending request: urn:request:8dbe82bc-77b2-41dd-9979-77b8e71f7bfb (/health/instance) gunicorn-web stdout | 2020-07-23 07:19:59,433 [419] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2020-07-23 07:19:59,434 [419] [INFO] [gunicorn.access] 10.128.2.1 - - [23/Jul/2020:07:19:59 +0000] "GET /health/instance HTTP/1.0" 200 190 "-" "kube-probe/1.17+" nginx stdout | 10.128.2.1 () - - [23/Jul/2020:07:19:59 +0000] "GET /health/instance HTTP/2.0" 200 190 "-" "kube-probe/1.17+" (0.053 49 0.053) builder stdout | 2020-07-23 07:19:59,586 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 notificationworker stdout | 2020-07-23 07:19:59,911 [113] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2020-07-23 07:19:59,912 [113] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:20:06.997992+00:00 (in 7.086037 seconds) 2020-07-23 07:19:59,912 [113] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:20:09 UTC)" (scheduled at 2020-07-23 07:19:59.911177+00:00) 2020-07-23 07:19:59,912 [113] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2020-07-23 07:19:59,914 [113] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 19, 59, 912928), True, datetime.datetime(2020, 7, 23, 7, 19, 59, 912928), 0, u'notification/%', 50, 1, 0]) notificationworker stdout | 2020-07-23 07:19:59,924 [113] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:19:59,925 [113] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2020-07-23 07:19:59,925 [113] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:10], next run at: 2020-07-23 07:20:09 UTC)" executed successfully security_notification_worker stdout | 2020-07-23 07:20:00,353 [101] [DEBUG] [apscheduler.scheduler] Looking for jobs to run security_notification_worker stdout | 2020-07-23 07:20:00,354 [101] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:20:30.351857+00:00 (in 29.998110 seconds) 2020-07-23 07:20:00,354 [101] [INFO] [apscheduler.executors.default] Running job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:20:30 UTC)" (scheduled at 2020-07-23 07:20:00.351857+00:00) 2020-07-23 07:20:00,354 [101] [DEBUG] [workers.queueworker] Getting work item from queue. security_notification_worker stdout | 2020-07-23 07:20:00,356 [101] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2020, 7, 23, 7, 20, 0, 354763), True, datetime.datetime(2020, 7, 23, 7, 20, 0, 354763), 0, u'security_notification/%', 50, 1, 0]) security_notification_worker stdout | 2020-07-23 07:20:00,365 [101] [DEBUG] [workers.queueworker] No more work. 2020-07-23 07:20:00,366 [101] [DEBUG] [data.database] Disconnecting from database. security_notification_worker stdout | 2020-07-23 07:20:00,366 [101] [INFO] [apscheduler.executors.default] Job "poll_queue (trigger: interval[0:00:30], next run at: 2020-07-23 07:20:30 UTC)" executed successfully builder stdout | 2020-07-23 07:20:00,586 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:20:01,587 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 builder stdout | 2020-07-23 07:20:01,723 [130] [DEBUG] [buildman.server] Checking for more work for 1 active workers builder stdout | 2020-07-23 07:20:01,738 [130] [DEBUG] [buildman.server] No additional work found. Going to sleep for 10 seconds builder stdout | 2020-07-23 07:20:01,738 [130] [DEBUG] [data.database] Disconnecting from database. builder stdout | 2020-07-23 07:20:02,587 [130] [DEBUG] [buildman.component.buildcomponent] Got heartbeat on realm bbb37ba9-57a1-4883-a8e6-b99378195e48 securityworker stdout | 2020-07-23 07:20:03,477 [128] [DEBUG] [apscheduler.scheduler] Looking for jobs to run 2020-07-23 07:20:03,478 [128] [INFO] [apscheduler.executors.default] Running job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:20:33 UTC)" (scheduled at 2020-07-23 07:20:03.476607+00:00) 2020-07-23 07:20:03,479 [128] [DEBUG] [peewee] ('SELECT Min("t1"."id") FROM "image" AS "t1" WHERE ("t1"."security_indexed_engine" < %s)', [3]) 2020-07-23 07:20:03,478 [128] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2020-07-23 07:20:33.476607+00:00 (in 29.998773 seconds) securityworker stdout | 2020-07-23 07:20:03,491 [128] [DEBUG] [peewee] ('SELECT Max("t1"."id") FROM "image" AS "t1"', []) securityworker stdout | 2020-07-23 07:20:03,492 [128] [DEBUG] [data.secscan_model.secscan_v2_model] Found no additional images to scan 2020-07-23 07:20:03,493 [128] [DEBUG] [data.database] Disconnecting from database. securityworker stdout | 2020-07-23 07:20:03,493 [128] [INFO] [apscheduler.executors.default] Job "_index_in_scanner (trigger: interval[0:00:30], next run at: 2020-07-23 07:20:33 UTC)" executed successfully